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FOREWORD 


Ten volumes dealing with different subjects at the 
undergraduate level have already appeared in the Ques¬ 
tion Banking Series. Thirteen more are under prepara¬ 
tion and one of them is to deal with English. 

The problems of teaching of English are slightly 
different from other subjects. As a result of discussion 
and some preliminary workshop experience, the Research 
Cell has therefore prepared a special monograph dealing 
with Question Banking in English Language and Litera¬ 
ture. Those teachers who are seriously interested in 
the professional problems of how to teach English would 
find it a useful volume, indeed one which will make them 
reflect over what they are doing. Certain new techniques 
are presented. Even if each one of them is not found 
acceptable at least so me of them would be found accepta¬ 
ble. It is in this hope that the volume is presented to the 
teachers of English. 


May 14, 1978 


Amrik Singh 
V ice-Chancellor 
Punjabi University, Patiala 



PREFACE 


Lord Cromer*s witty dig at the eccentricities of English 
language may serve to usher us into our subject: 


"When the English tongue we speak* 

Why is break not rhymed,with freak ? 

Will you tell me why it*s true 
We say sew but likewise Jew ? 

Beard sounds not the same as heard ; 

Cord is different from word; 

Cow is cow, but low is low , 

Shoe is never rhymed with foe; 

And since £ay is rhymed with say, 

Why not paid with said, I pray? 

And in short it seems to me 
Sounds and letters disagree. 

Nevertheless, English language like all other languages, is a 
system. It needs no apology, therefore, to treat the teaching 
and testing of English as a system. If our experience at va¬ 
rious Question Banking Workshops with the teachers of English 
is an indication, teaching and testing of both language and lite¬ 
rature must fall into a systematic conceptual framework. The 
notion of Question Banking provides that framework. The ob¬ 
jective of this n onograph is to make this conceptual fran.ework 
explicit, to examine and establish its usefulness for English 
language and literature, and to offer some sample iten s/ques¬ 
tions to build up a Question Bank in English Language and Lite¬ 
rature. 

This is a modest attempt to inject a bit of science into 
the testing of English Language and Literature and to pave the 
way for a systematic planning of a question paper, with balanc¬ 
ed weightages to be given to various objectives and type of 
iten.s/questions. However, the basic thrust is in the direction 
of writing good quality iten.s/questions. 


V. N A TARA JAN 
SATYA PAL JULKA 
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QUESTION BANKS-USES IN INDIAN 
UNIVERSITY EXAMINATIONS 


1.0 INTRODUCTION 


Like fume-free cars and the Kingdom of Heaven, question 
banking is one of those ideas which has great appeal but which 
people do little about. In that respect, the position is little 
changed from 1971 when the Association of Indian Universities 
recommended strongly that the University Boards of Studies 
should ' frame* not only syllabus but also a 1 2 Bank of questions' 
for each of the courses. Many universities have since tried 
to expand their syllabi in various subjects into meaningful 
objectives and produced resource materials for students and 
teachers including evaluation materials. This is in keeping with 
the Report of the Education Commission ( 1964-66 p. 220 ) 
where it is said 1 examination reform has become crucial to all 
progress and has to go hand in hand with the improvements in 
teaching'. The Radhakrishnan Commission said, ' if we are to 
suggest a single reform in University Education, it is that of 
examination reform'. Dr. Amrik Singh strongly feels that 
priority should be given to improvements in teaching in 
universites and that it is wrong to suppose that changes in 
examinations will automatically produce desirable changes in 
university teaching. It is wise however to effect changes in both 
teaching and testing. Question banking is one of the strongest 
ideas that will attempt to integrate teaching and testing at both 
individual university's level and ^mongst various universities of 
the country. Some universities have gone ahead with Question 
Banking and many others^ are on their way to implement 
Question Banking as a part of examination reform. At the same 
time a good number of universities is still either undecided or 
unaware of the potentialities of Question Banking. While 
individual universities/institutions should be given encouragement 


1. Universities of Calicut, Poona, Rajasthan. 

2. Universities of Madras, Madurai, Mysore, Bombay. 
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and assistance In the matter of Question Banking, a need to create 
an initial Question Bank in major first degree level subjects 
useful for all universities in the country was strongly felt in 
terms of saving of time, effort and resource and also in terms of 
bringing about uniformity and standardisations,of some kind. The 
Association of Indian Universities, in its Research Unit on 
Examinations, has taken it up as a major development activity, 
constituting initial Question Banks in First degree level subjects 
of Mathematics, Physics, Chemistry, Botany, Zoology, History, 
Geography, Psychology, Economics and Commerce. In all, 
there are about 60,000 questions/items in these 10 subjects and 
these have been prevalidated, coded, classified and stored in 
the form of 8” x 5 H cords in Kardex trays. Question banks, makin 
full use of the accumulated experience of teachers and examiners, 
represent an important potential contribution to the process of 
examining. In our country, the last decade or so has seen a 
marked desire for improvement in examining, perhaps character¬ 
ized chiefly by the evolution of improved school examinations by 
NCERT and other agencies in the various states and research 
into and concern for increased technical efficiency. The need 
at this time to consider and discuss such possible innovations 
as question banks is particularly strong in view of the increasing 
load which the existing pattern of examining must bear. The 
need is caused by rising numbers taking various examinations , 
widening range of examinable subject matter, the need for more 
frequent revision of syllabi, the breaking down of traditional 
subject boundaries, the movement towards a greater degree of 
involvement by teachers in the examining process and the 
continuing use of examinations for course evaluation, pupil 
diagnosis, educational guidance and selection. 

At the same time the demands to examine with justice and 
to maintain and improve standards are as strong as they have 
ever been and may well become stronger as a larger proportion 
of the population comes to be directly affected by examinations. 
Therefore, the task of examining which already involves 
considerable educational and administrative effort will inevitably 
become more difficult and comolicated in the years ahead. All 
this adds vigour and point to the search for improved methods of 
examining and compels careful consideration of the role of 
n question banks”. 
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The main objective of this monograph is to propose a plan 
of action to build up Question Banks in our country through 
co-ordination of different organisations and universities avoiding 
duplication of efforts, piecemeal work and adhoc decisions of 
subjects. Some practical ways of building up and using Question 
Banks in the present context and thus maintain their dynamic 
concept are suggested. 

2.0 WHAT IS A QUESTION BANK 


There is nothing revolutionary in the idea of a Question 
Bank. Stores or banks of questions have been in existence 
for a long time. Over the years, various universities, and 
examining boards have produced a large number of questions 
in many different subject areas; these in effect constitute a 
series of banks from which questions are drawn for examining 
purposes and to which new questions are added from time to 
time. Similarly most teachers have developed their own 
questions for assessing the progress oftheir students. Teachers 
and examiners will be familiar, of course, with the task of 
drawing up suitable questions for purposes of assessment and 
teaching. Most of these questions were set largely on an 
intuitive basis because they looked "right" or bacause they 
seemed to work. In the hands of an experienced teacher or 
examiner this process has generated a considerable store of 
questions that time has shown to be of merit. But such 
teachers and examiners have been few in number so that the 
less experienced have not had the same opportunity to develop 
this kind of judgement on the questions they devise and select. 

Question bank in the sense used in this monograph 
contains questions about which there is available some specific 
information, usually of a statistical nature. In this sense they 
differ from question banks already built up by teachers and 
examiners. The main function of a Question Bank, if one were 
established would be to make available to teachers and 
examining bodies such questions together with associated 
information that they might wish to use in preparing their own 
tests and examinations during or at the end of a course. 
Individual questions would be selected on the basis of experience 
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gained in using the questions " in the field". Another task 
of a question bank would be to help provide an estimate of 
the degree of comparability of examinations produced in 
this way. 

The process of producing questions for a question bank 
might well result in a clarification of the aims and objectives 
of the examinations. This could lead to the specification of 
subject objectives in fairly precise and detailed terms. It 
would be a mistake to suppose, however, that a Question 
Bank would consist solely of those questions in which the 
course objectives can be accurately defined and measured. This 
would be a narrow interpretation of the way a Question Bank 
would work. A Question Bank could clearly be composed of 
all kinds of questions now being used for internal and external 
assessment, ranging from the " open" or " essay type" to the 
" closed" or "objective" type questions. It is necessary that 
a question bank must contain a large number of questions/ 
items in a particular subject. Going beyond written questions/ 
items there is no reason why other kinds o 1 tasks such as oral 
questions, dictation, musical passages, project topics and 
practical experiments should, not be stored provided that some 
quantitative evaluation of them will be made. Perhaps 
'Question Bank' is itself'too restrictive a description of the 
enterprise, may be 1 task' ox 4 stimulus' Bank is more appropriate 
a shift in emp hasis which brings the conception very close 
indeed to two other kinds of educational bank bruited recently, 

" a resource bank" and " a syllabus bank. " 

The Examination Bulletin 3* describes the Question 
Banks as follows: 

"A BANK OF ITEMS ( QUESTIONS) OF KNOWN TECHNICAL 
VALUES CAN BE BUILT UP FOR FUTURE USE. IT MIGHT, 
IN PRACTICE, PROVE OF VALUE TO ARRANGE FOR 
ITEM CONSTRUCTION TO BE A MORE OR LESS CONTI¬ 
NUOUS PROCESS. THE CONSTRUCTION OF WRITTEN 
PAPERS CAN THEN BECOME A MATTER OF JUDGING 
THE SUITABILITY OF ITEMS OF KNOWN TECHNICAL 
VALUE FROM A BANK OF ITEMS. ITEMS CAN BE 
WEEDED OUT AS OUT OF DATE OVER A PERIOD OF TIME. 
FURTHER IT CAN BE SAID THAT NEW QUESTIONS SHOULD BE 
TRIED OUT A* D STATISICAL EVIDENCES FOR ITS 
FACILITY.DISCRIMINATION ASCERTAINED, IT IS ABSO¬ 
LUTELY NECESSARY THAT THE BANKS WOULD HAVE 

TO BE LARGE TO BE OF VALUE." _ 

1. Examination Bulletin 3"Use: An introduction to some techniques of 
Examining", HMSO , 1964. 
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3.0 WHAT CAN A QUESTION BANK OFFER 


A question bank allows careful pretesting of questions 
from which advance information could be made available to 
examination boards; such information being of a statistical 
nature , sometimes accompanied by a description of the 
learning objective that the question was intended to measure 
This description helps to decide retention, improvement or 
rejection of questions. The data would complement the 
judgment of examiners and teachers and not in any way 
supplant their necessary freedom to select their own questions. 
The practice of pretesting questions with representative samples 
would mean that teacher could compare the performances of 
his own students with those of the wider population, thus 
contributing to the overall maintenance of national standards. 

A carefully built up Question Bank can influence curriculum 
development. In building up a bank of questions some re¬ 
appraisal of what these questions were intended to reveal in 
terms of pupil learning might become necessary. A Question 
Bank could be composed then, in part at least, of questions 
produced to fit this specification of objectives. Each question 
would be related to a particular objective oi learning and 
would therefore play a small but vital parj in measuring the 
total achievements of the individual. 

The potential advantages are thus obvious. A Question 
Bank offers the chance (a) to produce and evaluate question 
on a relatively more effective basis; (b) to carry out 
concurrent comparability; (c) to match the examinations 
to the curriculum that is taught and not as tends to happen 
in the conventional setting the other way round. The Question 
Bank would act as a neutral educational and administrative 
service helping teachers and examiners to solve some of 
the problems with large-scale examining. 

4.0 HOW MAY A QUESTION BANK WORK ? 

The workability of Question Bank may depend on scope, 
scale of operations, the relationship with examining bodies 
and colleges and universites, financing and administration. 
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There are many possibilities of organising question banks 
in practice. It is proposed to give guidance regarding the 
various ways in which questions might be developed and used 
in a Question Bank. 

Universities that are selected to implement examination 
reform are to work in a coordinated way and help each other 
where possible. 

There are two possible procedures that suggest themselves, 
The first procedure would involve the use of questions and items 
already in existence which examiners and teachers considered 
to satisfy their criterion of n good M questions. These might be 
specific questions or they may be objective type questions. 

The second procedure would require that questions were 
developed to measure as precisely as possible those objectives 
of learning that teachers and examiners considered important. 
Such questions/items would normally be devised at the end 
of a period during whidh some detailed reapprisal of learning 
objectives had been undertaken, the aim being to relate the 
questions to the specified objectives to build in validity. In 
an affiliating type of university, teachers drawn from different 
colleges teaching subjects at the same level are to be given 
a short orientation into areas of objectives, strengths and 
weaknesses of different types of items and questions and 
initiated into the scientific skill of item writing. An initial 
attempt may be spread over a period of 3 weeks in a workshop 
type course. 

Initially, one may tend to use the first procedure which 
is a good starting point. However, the second procedure 
ensures that questions and items satisfy validity and it may 
well generate and train a number of teachers as item writers. 
Whatever procedure is adopted ( a combination of the two, is 
however advocated) , certain features are common, a) Question/ 
items must be tried out in the " field " or 11 pretested” in order 
to obtain statistical data about how the questions/items behave 
with a sample, on the basis of the statistics, such questions/ 
items must also be retained, modified or rejected, b) Questions/ 
items must also be tried under actual examination conditions. 
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In this case the decisions about questions would be mad e after 
the event and not More as in the case of pretesting. But this 
may be valuable to yield operational characteristics of questions 
supplementing information from pretesting* 

One may suggest writing out on cards (designed for the 
purpose) the questions to constitute the Bank and stored. An 8”x5” 
size card is ideal for storing in Kardex trays. Punched cards 
may be used and items/questions stored in computer. It may 
also be published as a ” brochure”, each question with related 
statistical information, the learning objective tested efc. Guide¬ 
lines may be given in the matter of selecting questions from the 
brochure or from cards or from the computer. A question 
paper may be made with questions from the bank to which 
some others may also be added. The items/questions that 
are drawn from the bank are to be analysed statistically and 
the data entered in appropriate columns in the cards. Items 
which are of objective type , when they constitute a test, may 
be marked and graded with the use of a digital computer. A 
computer programme has been developed that will mark the 
answer scripts of a test with objective type test items 
( Multiple choice) and make statistical analysis as well. 

It would be difficult to imagine a Question Bank developing 
it full potential without making use of the technical and admini¬ 
strative advantages of a computer. The handling of large 
scale computations, the drawing of samples, the storage and 
retrieval of questions and related data argue the case for a 
computer. A question bank could however operate on a more 
limited scale, without being based on computer technology. 

For the use of teachers to make classroom tests ( continuous 
assessment) a brochure type bank of items that are to be 
pretested may be preferred. As the items/questions which 
are found to satisfy the criterion of facility, discrimination, 
difficulty level, could be made into a bank of questions for the 
examiners to use in making ’’end of term” university examinations. 
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5.0 CAN A QUESTION BANK BE USED FOR ALL SUBJECTS 


Although the actual logistics of operating a question bank 
for sample pretesting and statistical analysis might appear 
alike in most subjects , certain subjects probably lend them- 
selves more readily to the concept of question banking than 
others. Mathematics, biology, physics, strength of materials, 
electronics, might be thought more amenable to a detailed 
analysis of learning objectives than history, modern languages, 
psychology, human geography. It is very difficult to spell 
objectivies in the latter subjects while it is very easy to do so 
in respect ot the former. Teachers may think that question 
banking suits those subject areas in which it is thought easier 
to express questions in objective form. One might think that 
a question bank has very little to offer about subjects in which 
objectives are predominantly oral and skill-oriented though 
there is no logical reason why tape-recordings, scale exercises, 
prose passages, and the like should not be stored inn-question 
bank. There are difficulties in applying an uniform concept of 
question banking to all subjects, though writing objectives is not 
a necessary precondition. 'Questions could still be used pretested 
analysed statistically in situations where objectives had not clearl 
been stated. Objective type examination has the advantage in the 
sense that accurate statistical analysis can be made. Essay 
type, problem type questions can also be used in the question 
bank even though statistical analysis in such cases tends to 
be crude. 

6.0 CANA QUESTION BANK MEET LOCAL NEEDS 


In a few subjects like geography and history, it may be 
necessary to adopt questions to local needs. Questions in 
these subjects may be classified as a) those that are of 
universal significance, b) those that use local place-names to 
illustrate a situation but could be adopted for universal use and 
c) those that are not amenable to adoption in any way. It is wise 
to keep the percentage of questions in (b) and (c) to a minimum. 
The idea is that question bank can be used by many universities 
and that each univerity can work in a few predetermined areas 
or subjects so that duplication of efforts can be avoided. The 




13 


time, money and effort that goes into scientific production of 
questions for* bank in a country like ours necessitates such 
coordinated -ways to do the job. It is also healthy to exchange 
the banks in different subjects from different universities. Such 
coordination and cooperation among the selected universities 
is strongly recommended so that these universities with the 
least expenditure of time, money and effort can produce and 
create item banks in different common subjects on a sharing 
basis . The Association of Indian Universties , with its 
Research Cell, is now quite willing to bring about this 
coordination and help produce a Central Bank of questions/ 
items in first degree subjects for use by all Indian Universities. 

7.0 STATISTICAL PROCEDURES 

It is proposed to give an outline of more basic calculations 
that may be used in the operation of a question bank. More 
advanced techniques have been developed and it is probable that 
some modified form of these would be used in the operation of 
every large scale question bank. The main statistical technique 
is known as item analysis. In performing item analysis two 
main values are computed: (1) Facility Value ( F.V.) and (2) 
Discrimination Index ( D.I ). The first indicates the difficulty 
level of the question ( whether it is hard or easy ) and the seconc 
indicates the extent to which the question discriminates between 
good and poor candidates. A conventional item analysis is 
as follows: 

(a) Place all the completed scripts in order of merit of 
marks on the whole paper. Divide them into equal 
portions. Sixths or fifths are commonly used. 

(b) Take each candidate, paper and for each question in 
turn, count the number of candidates who gave each 
of*the four/five possible answers in each of the sixths. 

( This is a multiple choice question with 4/5 possible 
answers). Thus ail the responses are included in the 
analysis. This is useful because it may be possible to 
see whether a particular answer is attracting too many 
responses and acting as what test constructors call 

a " distractor. “ 
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(c) A grid can then be completed, Suppose B is the 
correct answer . 


Answer 

a 

ES 

c 

F 

£ 

Total 

P6 

P3 

Top sixth 

m 

12 

1 


B 

18 

0.67 

0.47 

2nd sixth 


8 

m 


it 

17 

0.47 


3rd sixth 

l 

9 

9 

1 


18 

0. 50 


4th sixth 

2 

9 

9 

3 

9 

18 

0. 50 


5th sixth 

3 

”4 

■ 

1 

5 

17 

0. 24 

0. 14 

Eotom 

5 

1 

3 

4 

5 

18 

0.06 


sixth 










m 

Ml 

16 

Bl 

18 

106 

0.41 



P6 proportion of total number of candidates in each 
sixth who obtained the correct answer. 


P3 proportion of total number of candidates in each 
theird who obtained the correct answer. 

(d) The grid shows 43 out of 106 answered the question 
correctly. Thus the question has a facility value of 
43 x 100 = 41%. This is on the low side for an 

106 

attainment examination. 

(e) The D. I. value is computed in many ways. It is 
obtained by (i) subtracting the F. V. of lower third from 
the F.V. of upper third. 

(ii) subtracting the F.V. of lower ability group from 
the F.V. of the higher group (Top 27% of population) 
Lower ability groups Bottom 27%. 
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(f) Based on thirds, D. I. of this item= 0. 57-0.14=0. 43 
Ideally we would aim to have a D. I. value around 0. 8. 

In practice # lower D. I. values of around 0.6 are 
acceptable • 

The value of these statistics lies in their capacity to 
identify unsatisfactory questions. A high F.V. means low D. I. 

Lew D.lmay be also due to low F.V. This means that the item is too 
easy ( former case) or too hard ( late r case) to be able to 
discriminate good from bad ones. A question may be confusing 
or ambiguous. As a rule, the distractors must be accounting 
for a greater number of lower ability group than higher ability 
group. An option that is not the correct answer should 
negatively discriminate. 

When one is attempting to sample a defined body 
of content as in a subject examination, if is usually 
undesirable to drop questions just because their FV. and 
D. I. values are low. Most examiners will tolerate low 
value on the grounds that these will contribute to better 
sampling and enable high content validity to be secured. 

Generally speaking+high D. I. values are required when 
it is necessary to distinguish different levels of achievement 
(Selection) . Where however the examination is designed 
to provide feedback information for the purpose of course 
evaluation, a high D. I. value is of less importance. 

One important point that is to be borne in mind is the 
difference in statistics that would arise for pretesting and 
actual examination conditions since it will be very difficult 
to get a representative sample. 

8.0 COMPARABILITY & MAINTENANCE OF STANDARDS 

Careful pretesting of questions on representative samples 
of the relevant population would be intrinsic to the operation 
of a question bank. Each question tested in this way would 
have a wid£ national significance and would be used by 
teachers and examiners as a basis for comparision between 
their own candidates and those of the pretest sample. Teachers 
would compare the item statistics calculated for their own 
group of students against those for the pretest sample. In 
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this way the question bank can provide evidence to teach ers about 
the performances of their students relative to others following 
similar courses and would thereby help to maintain standards 
at a reasonably constant level. The proportions of the pretest 
sample in each grade band who correctly answered the various 
questions would be known. This can help to predict their 
grades in the examination reasonably correctly. 

9.0 TYPES OF QUESTION BANKS 


The types can range from a collection of past examination 
papers of a university or class test items of a teacher to the 
most sophisticated stored items/questions in the computer. 

(1) A collection of items/questions published in the form of a 
booklet/brochure may be made available together with those 
prepared by a group of teachers after analysing objectives 
of learning various content areas. Initially this may be used 
for pretesting and collecting statistical evidences. (2) Once 
a reasonable statistics is obtained, each item/question is 
looked at critically and retained, improved or rejected. Those 
that are improved and retained will be transferred on to cards 
especially designed for the purpose for use by examiners to set 
end of term or university examinations. (3) Those items/ 
questions that are retained can also be stored in the memory 
of a digital computer. Whatever type is chosen , the dynamic 
concept of question banking must be kept up. 

10.0 FUTURE OF QUESTION BANKS 

This explains the concept of a question bank, to describe 
how it might work and to explore some of the issues involved. 

It is hoped that this would be discussed by every University/ 
Examination Board/Institution trying to build up question 
banks in our country and evolve methods that would be feasible, 
taking into account local conditions and constraints. Evidence 
collected on the operation of Question banks in the next few 
years will certainly add another dimension to modern examining 
procedures in our country. 



SECTION II 


QUESTION BANKING-OUTCOMES 
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QUESTION BANKING - OUTCOMES 


It is indeed necessary for us to look at some of the 
possible outcomes of Question Banks. Outcomes are 
very many and they depend on how teachers, students, 
administrators and universities use the question banks. 
As outlined earlier, the Question Bank consists of a 
large number of different types of questions/items in 
every subject, with known technical values. 

Some technical values of a question /item are : 

i) The content area/topic with which it is concerned. 

ii) The intellectual ability that the question/item 
demands of the student. It may be knowledge, 
comprehension, application, analysis, synthesis 
or evaluation. 

iii)The time required for answering. 

iv) The type of question/item whether selection 
or supply. 

v) Marks allotted. 

vi) Facility value or difficulty index 

vii)Di8crimination index. 

The most important outcome is the availability of a 

large number of questions/items in both selection 

and supply types. Selection type includes : 

a) constant alternative T/F 

b) multiple choice 


c) multiple facet 
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d) matching (simple and compound) 

e) rearrangement 

and supply type includes : 

a) simple question 

b) completion 

c) short answer question 

d) long answer question 

e) problem solving 

When the questions/items are carefully selected 
from sources of 

1) specially conducted Question Banking Workshops 

2) item writers/teachers, and 

3) past examinations 

it is very likely that they can be made to measure 
important abilities in a,content area and for various 
content areas. In Question Banking Workshops, it 
will be possible to clarify outcomes of learning a 
content area and expose to valid ways of testing the 
achievement of these objectives of learning systema¬ 
tically so much so that questions/items generated 
from these workshops will be of very good quality. 

A good number of teachers have already been trained 
in the science of item writing and they are also 
involved. Such questions/items are prevalidated 
with a checklist of criteria for good quality questions/ 
items and some technical values namely (i) to (v) 
above are incorporated. 
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Teachers in colleges/universities teaching 
these subjects are now helped with a collection of 
questions/items prevalidated and they can initially 
use them for class tests. Various universities can 
use these questions/items for the end of semester 
or year examinations. 

Teachers can analyse the responses of students 
and begin to undertake the professional tasks of test 
and item analysis and work out facility value and 
discrimination index of these and make inferences 
about teaching, student’s learning etc, 

II. Teachers and examiners will spend very little time 
in making up class tests and university examinations 
and spend the time thus saved in analysing responses 
and improvement of questions /items. Every depart¬ 
ment in a college can arrange to store items/questions 
in specially designed 8”x5*‘ cards and store them in 
Kardex trays. The Controller’s office can adopt a 
similar procedure or even store these questions /items 
in the memory of a digital computer. There can be 

a considerable saving of time and effort in making 
up question papers. If the initial questions/items 
bank is fairly large, (atleast 20 to 30 times the number 
of questions in a single paper) then the choice of 
questions/items is meaningful. 

III. Teachers and examiners will be continuously involved 
in creating more and more items for inclusion, thus 
keeping themselves professionally involved. 

IV. There can be a backwash effect on teaching. The 
nature of questions/items being so varied, will 
impose innovative methods of efficient teaching and 
effective learning. 

V. Question banks offer to carry out concurrent compa¬ 
rability. The same items/questions at the same 
level returning the same statistics of FV and DI in 
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different universities will ensure comparability 
of standards. A third university that returns very 
poor FV and DI for the same items, can be rightly 
said to have low standards. It is thus possible to 
provide a definition of standards and question banks 
if carefully designed and operated, will help maintain 
' standards*. 

VI. Question Banks if carefully built up can influence 
curricular development. A meaningful way of 
interpreting syllabus, writing objectives, building 
valid questions/items are some of the possible 
gains. 

VII. This may well generate a number of teachers as item 
writers. They will develop scientific skills not only 
in item writing but also in prevalidating them. 

VIII. If FV and DI are known for all items/questions, 
teachers can use Question Bank for making diagno¬ 
stic tests, mastery tests and criterion referenced 
tests etc. 

IX. Careful pretesting of questions on representative 
samples of the relevant population would be intrinsic 
to the operation of a question bank. Each question 
tested in this way would have a wide national signi¬ 
ficance and would be used by teachers and examiners 
as a basis for comparison between their own candi¬ 
dates and those of the pretested sample. Teachers 
would compare the item statistics calculated for 
their own groups of students against those from the 
pretested sample. In this way, the Question Bank 

can provide evidence to teachers about the performance 
of their students relative to others following similar 
courses thereby helping to maintain standards at a 
reasonably constant level. The proportions of the 
pretest sample in each grade band who correctly 
answered the various questions yrould be known. 

This can help to predict their grades in the examina¬ 
tion reasonably correctly. 
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X. Teachers, examiners and Boards of Studies 

members will be quite prepared to restructure 
- their question papers in various subjects including 
more and more of objective and structui . d short 
answer questions, thereby ensuring increased 
content validity and overall reliability of their 
examinations. It is very likely that written papers 
in various subjects may be made up of a Part A 
objective (20 to 30 items for \ hour) Part B short 
answer structured questions (10 to 15 questions 
for 2 hours) and Part C long answer /problem solving 
questions ( 1 to 2 questions for \ hour). 




SECTION III 

EXAMINATIONS: REFORM OR BANISH 
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EXAMINATION : REFORM OR BANISH 


A general feeling of dissatisfaction with the questions set in our 
current examination papers, a need for reforms in the direction 
of questions of better quality and of varied types, are some of 
the conclusions that can be drawn from a survey conducted over 
a large population of university teachers of humanities and so¬ 
cial sciences, drawn from various universities of the country. 
The teachers were requested to answer a questionnaire with a 
built-in flexibility for a personal touch. Interestingly there are 
two voices treating any examinations or testing in any form 
whatsoever as ’kill joy’ and deserving of banishment from the 
process of teaching and learning. The plea for banishment may 
be a stylized idiosyncratic demand, but about reforms there 
can be no two opinions. 

Practically all the teachers think that the present day 
question papers lay sole emphasis on essay type questions. This 
not only leads to subjectivity in evaluation and marking, but also 
proves to be self-defeating in its aims and objectives. While 
laying claims to test examinees’ power of expression, the ques¬ 
tions soon tend to become stock questions, only a few in number 
and examinees, by and large, resort to cramming and rote¬ 
learning. Some of the teachers are also of the opinion that 
certain sincere exan inees, honestly aiming at displaying their 
power of writing by attempting answers on their own, prove to 
be a disn al failure by committing grammatical errors and 
losing cohesion over a long stretch of writing. While responding 
to the question of how they are able to circum vent their propen¬ 
sity to subjectivity in evaluation and n arking, in the given situ¬ 
ation, the teachers have mentioned their sense of honesty, 
sincerity of purpose, and joint meetings to evolve criteria in 
eases where the answer books are distributed over two or more 
examiners. Of course, a majority of them does not have an 
iota of doubt about objectivity in evaluation as the basic goal to 
aspire after. However, five teachers have taken subjectivity 
as the privilege of an examiner, one of them going to the extent 
of pointing out that he can award high marks even when pleased 
with just one sentence in an essay type answer. 


One of the ways of achieving the goal of objectivity in 
evaluation, mentioned by eighty per cent of the teachers, is to * 
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reform the type of questions set in the current examination 
papers. All of them have expressed themselves in favour of 
retaining essay type questions to test the abilities of expression 
but making them only a part of the question paper and not the 
whole of it. A question paper, it has been suggested, should 
include a variety of question types: 

i) Essay type (Traditional, possibly with built-in criteria 
of evaluation) 

ii) Short-answer type (To be answered in 50-200 words) 

iii) Simple type (To be answered in a sentence, or a 
phrase, or a word). 

iv) Objective type (to be answered by selecting the right 
answer out of given choices) 


However, at least 25 per cent teachers have expressed 
themselves against Objective Type Questions in humanities and 
social sciences. There seems to be no common ground on 
what the teachers expect of the learners to show as an overt 
demonstration that they have learnt what the teachers have 
tried to teach them. The only point of convergence is that the 
learners should be active, should ask questions, and should be 
able to answer questions orally and in writing. Hence the 
importance of questions and their quality. Whereas some of 
the teachers think that whatever is teachable is also testable 
and their main concern in teaching is with that, most of them 
have treated enjoyment as an essential component of teaching - 
learning process which seems to lie beyond testing, or at least 
objective type testing. All of them do not go to the extent of 
treating testing as ’kill joy’ to be banished from the process of 
teaching and learning, but certainly make a plea for the compo¬ 
nent of joy and enjoyment to exist as an integral part of the 
process. Perhaps more thought has tc be given to the ’affec¬ 
tive 1 component of learning a^d lessening of load on mere 
written tests by introducing continuous assessment. Surely 
banishment of exan inations is not possible. Here then is an 
atten pt in the direction of in proven *ent. 



QUESTIONNAIRE 


(1) Whatever be your field of teaching, poetry, prose, fiction, 
drama, criticism etc, what response do you expect of the 
learners to show that they have learnt what you have taught 
them? You may consider this in terms of one lesson or a 
series of lessons on a certain theme, or a course. Please 
write in about 200 words. 


(2) Are there any parts of learning which cannot be tested? 

£ _/ £ _/ Please put av^niark in the 

y es No relevant box. 

(3) What is your criterion for making a distinction between 
testable and non-test able parts of learning? Please state 
the criterion only, in a few words, without justifying it. 
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(4) In a written examination, what type of questions are 

required to test, what the students have learnt during the 


course of your teaching? Given below is a list of different 
types of questions. Please put a \/ mark against the 
ones you choose. 

1. EssayType 

/_/ 


2. Short-Answer Type (about 200 words) 

/_/ 


3. Direct Answer Type (that can be 
answered in a word, a phrase, or 
a short sentence) 

LJ 


4. Objective Type (that can be marked 
objectively) 

LJ 


a) Are you satisfied with the questions set 
in the examinations these days? 

Yes 

LJ 

No 

LJ 

b) Please mention the types here: 



1. Essay 

LJ 


2. Short Answer 

LJ 


3. Direct Answer 

LJ 


4. Objective 

LJ 



c) Please state your reasons here in about 50 words. 
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(6) 


a) Do you think that there is an element of subjectivity 
in marking/evaluating examinees* answer books? 


LJ l—/ 

Yes No 


b) If the answer is ^es*, what steps do you take to make 
it absolutely minimal? Please answer in about 50 
words. 


c) If the answer is *No 
about 50 words. 


please state your reasons in 




SECTION IV 


QUESTION BANKING IN ENGLISH LANGUAGE AND 
LITERATURE: NEED AND DEMAND 
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QUESTION BANKING IN ENGLISH LANGUAG E AND 
LITERATURE NEED AND DEMAND 

The response of the teachers to our questionnaire was a 
corroboration of what we had in a way already planned. Asa 
part of the implementation the involvement of a large number 
of teachers was essential. This was ensured by holding several 
workshops at various universities and colleges in the country, 
initiating the teachers into the writing of good quality items/ 
questions, to be collected, pre-validated and stored as a bank 
of items/questions for a field trial. Needless to add that the 
workshops provided us with a much needed feedback to modify 
and in prove our initial plans in several ways. 

However, the requisite conceptual framework was neces¬ 
sary and it was decided to adopt the fran ework used by the 
Association of Indian Universities for similar other projects 
earlier. A lot of field work and research had gone into the 
evolving of this framework and its plausibility had been tested 
and re-tested in several ways and spheres. An agreed syste¬ 
matic conceptual framework carries a powerful potential of 
ensuring communication not only within a certain specific dis¬ 
cipline but also across disciplines. 

One of the basic points to be realized is that the writing 
of items/ questions is a science and needs careful considera¬ 
tion and effort. Items/questions written on the spur of the 
moment may not invariably go wrong but run the risk of going 
wrong. Moreover, the much needed pre-validation in terms of 
systematic criteria is not carried out. Our experience has 
shown that it is not really an easy job to write items to test 
higher level abilities in literature, particularly when the con¬ 
tent involved is a novel, or a play, or an epic. However, that 
is no reason why an effort should not be made ^nd made collec¬ 
tively by teachers or at least shared in a certain planned and 
systematic manner. A question bank is a step in that direction 
and provides an opportunity to teachers to involve themselves 
in the process of testing their students and gain from the ex¬ 
perience of others. 

An initial question bank stores pre-validated iten s/ques¬ 
tions, ready for a field trial. The results of the field trial are 
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analysed according to rigorous statistical procedures and only 
those items/questions are retained that live up to the norms. 
Some of the statistical procedures have been included for re¬ 
ference and use as and when necessary. 

Another significant point of emphasis is that of the speci¬ 
fication of objective. Some mention of the desirability of 
specification of objectives for English Language and Literature 
will be made later. At this point it may be noted that items/ 
questions in a question bank are classified not only in terms 
of content but also in terms of objectives tested. A checklist 
of objectives, used for purposes of the illustrative items/ 
questions in the monograph, may be given here. 


CHECK LIST 

LEARNER BEHAVIOURS 

KNOWLEDGE Mostly ^erbalished information (terms, facts, 
classification, criteria, convention, sequenc¬ 
es, methods and procedures, descriptions, 
concepts, principles, laws, theories, deri¬ 
vations, proofs, etc.) 

Behavioural outcomes: 


LJ 

0) 

Recognise - specifics (from memory, among 
given things) 

LJ 

(2) 

Repeat/recall/recollect (previous learnings, 
experience; reproduced more or less in 
original form or in any ready made form) 

LJ 

(3) 

Follow - conventions, procedures, methods, 
processes (familiar situations) 

COMPREHENSION 


(Understanding of specifics in a communi¬ 
cation/ material/ situation), 


Behavioural outcomes: 


LJ < 4 > 


Locate specifics (as wanted or desired) 
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Identify/classify (by relevant criteria) 

Relate/ see relationship (compare, contrast, 
arrange in order so on) 

Detect/correct errors (in statements etc.) 

Transform/convert (translate, paraphrase) 

Illustrate/give examples (categories, situ¬ 
ations, usages, etc.) 

Interpret or elucidate (meaning, beauty etc.) 

COMPREHENSION 

(Understanding of a whole communication/ 
thing/phenomenon/situation;essentially in¬ 
volves analysis) 

Behavioural outcomes: 

Analyse into elements/relationships 

Generalise (from a body of information or 
data) 

Discriminate (by subtle differences) 

Deduce/derive/conclude/extrapolate;see 
applications/implications 

APPLICATION Of knowledge and understanding of concepts/ 
principles/laws/theories in new situations in 
the subject area/daily life (essentially invol¬ 
ves deductive reasoning) 

Behavioural outcomes: 

/_/ (15) Hypothesize (deductively) 

/_/ (16) Infer (by applying external principles, laws* 

or theories) 

£ _/ (17) Predict consequences or results (by applying 

external principles, laws and theories) 

/ 7 (18) Reason out/explain (cause/effect relationships) 


LJ <n> 
LJ (12) 

LJ (13) 
LJ (14) 


LJ < 5 ) 
LJ (6) 

LJ (?) 

n ( 8 ) 

LJ (9) 
LJ (io) 
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/ / (19) Establish relationships 

/ / (20) Solve problems (by applying principles* laws 

& theories - not just working out numerical 
problems) 

EVALUATION (Qualitative judgment of communication or 
other material by given/known criteria - 
internal or external) 

Behavioural outcomes: 

/_/ (21) Judge logical consistency importance, 

appropriateness, relevance, adequacy for 
a purpose, beauty, effectjgoodness, appli¬ 
cability 

/_/ (22) Criticise - different aspects by relevant 

criteria 

_/_/ (23) Justify or defend with sound arguments 

SYNTHESIS Into new forms, orginisations, patterns, 
designs, etc., with varying scope for in¬ 
telligence, imaginativeness, uniqueness 
and creativity 

Behavioural outcomes: 

/_/ (24) Integrate (combine or organise bits into 

one whole) 

/_/ (25) Epitomize (putting selected bits in a new 

structure) 

/_/ (26) Elaborate (adding detail on the basis of 

one f s logic or imagination) 

/_/ (27) Refine/restructure/recast 

/_/ (28) Compose/plan/design/evolve 

RESEARCH ABILITIES 



/_/ (29) Collect/organise research data 
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Interpret research data/findings 

Formulate research designs/plans/ 
procedures, analysis, etc. 

Evaluate research designs, procedures, 
analysis, report 

EXPRESSION 
Behavioural outcomes: 

/_/ (33) Choose/use appropriate words and phrases 

with precision 

/_/ (34) Choose/use appropriate sentence patterns 

with precision 

/_/ (35) Organise points in a good sequence and 

structure 

/._/ (36) Bring about beauty and effect through 

appropriate style 

PSYCHOMOTIC SKILLS 
Behavioural outcomes: 

L _/ (1) Speaking skills (pronunciation, accent, 

intonation, modulation, control of voice) 

/_/ (2) Writing skills (formations, spacing, neat¬ 

ness, legibility, etc.) 

_/_/ (3) Drawing & labelling skills (freehand 

sketching, drawing with instruments, 
systematic and neat labelling) 

/_/ (4) Laboratory/workshop skin like selecting, 

checking/testing, preparing, fitting, hand¬ 
ling, operating, reading, repairing, cali¬ 
brating (with correct techniques, precautions 
precision, speed and other dimensions of 
efficiency) 


/_/ (30) 
LJ (31) 
LJ ( 32 ) 



DESIRABLE INTERESTS: 


Behavioural outcomes: 

~J (i) 

Read literature other than text book 
material, make supplementary reference 

U (2) 

Pay attention to or observe related 
phenomena occurring in the environment 

~7 < 3 ) 

Jo in/assoc iate/assist/cooperate/partici¬ 
pate in the activities related to the subject 
(such as subject association activities, 
debates, field trips) 

U (4) 

Visit places of interest/undertake field 
trips for study 

_Z7 ( 5 ) 

Contribute/write articles to magazines, 
journals 

_Z7 (6) 

Initiate and invite others to participate 
in discussions 

,~j (7) 

Prepare/ collect and preserve things 
related to the subject (such as rare 
pictures, specin ens, models, reports, 
cuttings, biographies, speeches) 

ZJ (8) 

Improvise or devise (apparatus, methods 
and procedures) 

LJ ( 9 ) 

Seek to identify and solve challenging 
problems 

JU (1°) 

Stick to problems and never leave them 
unsolved 

LJ (ii) 

Perform new experiments or conduct 
studies on one’s own 

ATTITUDES 

(healthy, positive and scientific) 

Behavioural outcomes: 

Specifications 

L / ( 1 ) 

Observe phenomena keenly/scrutinize 
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material objectively 


LJ 

( 2 ) 

Seek fresh clues/evidence (logical/ex- 
perimental) beyond the ones already known 

LJ 

( 3 ) 

Accept opinions of others only on convincing 
proof or aigur* ents and not merely on 
authority 

LJ 

(4) 

Consider new interpretations, arguments, 
evidence*possibilities, ideas with an open 
mind 

LJ 

(5) 

Report honestly in clear and precise term 
what has been observed/thought out 

LJ 

( 6 ) 

Accept errors in arguments/opinions 
without hesitation/reservation and review 
them where necessary 

LJ 

(7) 

Suspend judgment till adequate evidence 
is available 

LJ 

( 8 ) 

'Seek logical consistency/validity in 
arguments 

LJ 

0 ) 

Arrive at conclusions on the basis of 
objective measurements/logical proofs 

PERSONALITY TRAITS 


( 1 ) 

Motivation, independence, initiative, self- 


discipline, responsibility, drive, sociability* 
leadership 


(2) Emotional maturity, balance and integration 

Social virtues/skills: 


(1) Interest in others( individuals and groups) 

(2) Good manners and other social graces 

(3) Good personal and social relationships 

i 

(4) Ability to get along with others 

(5) Ability to identify oneself with, participate 
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in and contribute to social activities, pur¬ 
poses 

Good habits/skills of studies/work 


Behavioural outcomes: 


LJ 

(i) 

Search/locate materials relevant 
(systematically with effective reference 
skills) 

LJ 

(2) 

Note/record/mark information accurately in 
a systematic way (with effective note taking 
skills) 

LJ 

(3) 

Sort out/organise/arrange/categorize/ 
compile material with speed and order¬ 
liness 

LJ 

(4) 

Display scheduling, punctuality 

LJ 

(5) 

Show neatness, cleanliness, orderliness, 
reasonable speed in everything done 


COMMUNICATION SKILLS 


(1) Receive and orally communicate (dialogue, 
discuss) 

(2) Receive and communicate in a written form 
(report writing, drawing) 


It may be noticed that the objectives presented are sub¬ 
ject neutral and it is for the teachers of English to pick out ob¬ 
jectives of teaching and learning for their discipline within this 
conceptual framework. The objectives are given in the order 
of ascending difficulty for the learner first in the cognitive 
domain and then in the affective and psychomotor domains, 
without eliminating the possiblity of an interplay. The objec¬ 
tives are operative on every unit of the content, configuration 
of units, or the whole syllabus, as the need be. An outline of 
the plan for Question Banking Project in English Language and 
Literature is given. 
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A Project Brief for Question Banking in English 


Objectives 


The objective is to prepare ( as large a number as possi ¬ 
ble) of pre-validated items/questions to be used by the teachers 
of English for purposes of test construction, continuous assess¬ 
ment, e.g., for summative as well as formative evaluation. 


Level: First Degree and Post graduate levels 


Content: 


Sources: 


The mode of identifying the content will be as 
follows: 

a) A copy of the syllabus from various uni¬ 
versities will be obtained. 

b) The common areas in the following cate¬ 
gories will be identified: 

1. Structures } 

2. Vocabulary Items { 

3. Speech Features { 


4. Literature 

5. Stylistic Varieties 

6. Communication Functions 

c) The objectives of testing and teaching will 
be classified and specified. 

a) Items/Questions written at various work¬ 
shops by the participating teachers will be 
collected. 

b) A large number of teachers, particularly 
those already trained at workshops will be 
requested to supply items/questions. 

c) Previous years 1 examination papers will 
be obtained and proper items/questions 
collected and used. 


Connected Text 

1. To be used 
for language 
teaching and/ 
or literature 

2. Literary 
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Classification of 

Objectives: The item /question writers will have to 

include instructional objectives and criteria 
as a part of items/questions. 

The teachers will be given short term courses 
to think in terms of objectives and write items/ 
questions accordingly. 

Form: The Bank will include 

i) Item s/Questions 

ii) Passages, poems etc., on which some of 
the items/quest ions are written. 

ii*) Tape recordings used for that purpose, 
iv) Some well-known works of literature 
can just be referred to. 
v) All the items/questions will be pre-valida- 
ted and classified according to the general 
plan of AIU. 

Pre-Validation: It will be done by teachers trained in the area. 

They will be drawn from a number of uni¬ 
versities. 

Tin e: The whole project should be complete in one 

year: 

i) 3 months for obtaining the current syllabi 
from various universities and defining the 
content. 

ii) The process of training teachers and 
collection of items/questions goes on 
simultaneously. Some of them have 
already undergone training at the AIU 
workshops. 

iii) A team of pre-validation experts is busy 
with the job simultaneously. 

iv) The whole process of pre-validated Items/ 
Questions Is completed within 10 months. 

v) Item s/Quest ions compiled in a book form 
in 2 months. 
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Storage: The Items/questions transferred to the AIU 

8 H x 5 M cards and stored in Kardex trays. 


Coordination: The work could be co-ordinated with the 

CIEFL, Hyderabad and a few other uni¬ 
versities. 

Field Trial: This will be undertaken as a carry over 

project for the next year. 


First Degree Level 
English Language and Literature 

The content area of the items/quest ions is proposed to be 
worked out as follows: 


1. Grammer 


2. Composition 


3. Prose selections and short : 
stories 


4. Poems 

5. Novels, including 
abridged versions 

6. Plays, including one act 
plays 


Verbs, Tenses 
Articles 

Voice (Active/passive) 
Narration (Direct/Indirect) 
Sentence Types 
Transformation of sentences 
Prepositions, Adverbial 
Particles 

Any other item specifically 
prescribed 

Paragraphs 

Letters 

Essays 

The selections will be made 
from the text books prescri¬ 
bed at various universities. 

The same procedure to be 
followed. 

To be selected on the same 
basis. 

The same procedure is to be 
followed. 
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7. English for special purposes 

Further suggestions from individual teachers* a group of 
teachers or department are welcome. 


Item/Question Types 


Selection 

Constant alter¬ 
natives 

Rearr angem ent 
Matching 
Multiple choice 
Multiple Facet 


supply 

Simple question 
Completion ques¬ 
tion 

Short answer 
question 
Long answer 
question 


English literature and language 
Honours - Postgraduate level 

The content areas will be worked out on the basis of the 
prescribed texts included in the syllabi of various universities. 
Poems, plays, novels, short stories, essays, etc. will be 
placed under the Heads of respective authors. 

History of English language & literature will also constitute 
a part. 

If elementary English linguistics forms a part of the syllabus 
at certain universities, it will also be included in the Question 
Bank. Critical theory will also constitute a part. 

Item/Question Types 

1. Multiple choice/facet 

2. Simple question 

3. Short answer question 

4. Long answer question 

Due emphasis will be placed on the objectives of teaching 
(simultaneously with content) and the items/questions should 
be prepared accordingly. 
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The notion of the specification of objectives is nothing 
new for the teachers of English acquainted with the recent de¬ 
velopments in the teaching of languages. What is therefore 
required here is only a step in the direction of a systematic 
approach or perhaps a new comprehensive systematic approach 
It is important to realize the distinction between objective type 
items and supply type questions. Objective type items involve 
selection only and can be marked objectively. Supply type ques¬ 
tions den and something to be provided or supplied by the exa¬ 
minee and the flexibility results in a certain amount of sub¬ 
jectivity in marking. Our text-books often carry a large num¬ 
ber of questions appended to them. The simple questions in¬ 
cluded there (usually known as comprehension questions) are 
sometin es supposed to be objective type, whereas they are in 
reality supply type. Moreover, there exists an in press ion 
that objective type items can test only knowledge. The in - 
pression is certainly not well-founded. 

This monograph carries some illustrative items/ques¬ 
tions, in the framework of objectives given in the checklist. 
These are only model items/questions in the neutral sense of 
the word, that is to say, in conformity to a certain model. The 
whole range of objectives has been covered, if not for one 
specific component of the content area, at least over different 
components. The selection of the content and the determining 
factors are as follows: 

1. General (receptive and productive skills: listening, 
reading, speaking, writing) 

2. A connected text for purposes of language teaching 
(Tagore 1 8 ’Babus of Nayanjore') 

3. The Silver Lining (a short story by an Indian author, 
Chaman Nahal), prescribed at the first degree level of 
Delhi University. 

4. An extrac* from ’Bores’ (by a British essayist, 

E. V. Lucas), prescribed at the first degree level of 
Delhi University. 

5. *No Road* (a poem by a living British poet, Philip 
Larkin), included in the syllabus of some Universities. 
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6. Some parts of ’The Portrait of a Lady’ (by an American 
novelist, Henry James), 

7. First scene of ’King Lear* (by Shakespeare) 


The first three in themselves include the whole range of 
objectives (cognitive) except (7), (28) and (36). (36) has been 
illustrated later on. There is a certain section of scholars and 
teachers who are of the opinion that testing examinees on wrong 
sentences has an adverse effect on language teaching and learn¬ 
ing . Some more problems pertain to appropriacy, intelligibility 
and correctness. (28) may involve the behaviour of preparing 
an outline which may be operative on any long-answer question. 
’Application’ seems to be included in ’Evaluation* and ’Synthesis’ 
in the context of English language and literature, except in the 
theory of language and literature, or criticism. ’Research 
Abilities’ has been excluded for obvious reason. The focus of 
attention in the other four areas is simply the illustration of 
varied types of items/quest ions. 


The general thrust of the illustrative items/questions is 
towards testing linguistic abilities in context:sounds, word, 
phrases etc. in sentences. Moreover, the emphasis is on the 
functional properties of language and not merely on the formal. 
It will not be difficult to notice that some of the items/ques¬ 
tions can be used both for receptive and productive skills. It 
is based on the assumption that all the skills should be taken 
care of simultaneously. 

The items and questions have been put down together 
after introductory remarks. Whereas it may be possible to 
separate language and literature on its extreme ends, it is 
rather difficult to draw a line of demarcation in the middle. 

It would have been easy for us to draw items/questions 
from here and there and put them down as illustrations, but 
to do that would be self-deceiving and self-defeating. We have 
written the items specifically for the monograph. They may be 
said to have been exposed to the process of pre-validation,* but, 
b arring a few, they hav e not been given a field trial. They 
*See Appendix 
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await the process of post-validation. We may conclude with 
the words of Roberts (Mark) about a literary critic, partly 
applicable to our endeavour also: 


"And even if we cannot, in this field, hope for absolute 
truth, it seems clear that we all in practice assume that some 
states of consciousness are better than others, more in touch 
with reality than others, and that what makes them so is both 
a possible and an important area for discussion. The critic^ 
task, therefore, is not to lay down unalterable, undiscussable 
judgement, from which the ordinary man dissents at his peril. 
It is to play his part in a co-operative enterprise which offers 
no prospect of finality, and where the aim is always to do 
better to see more clearly, than we have done before".* 


Before we come to English Language and Literature 
specifically, a table of specifications of Content, Behaviours 
and Criteria may be given. 


SPECIFICATIONS OF CONTENT, BEHAVIOURS AND 
CRITERIA 


I CONTENT 


1.01. 

Speech Features 


Selection 

1.02. 

Structure 

connected 

Gradation 

1.03. 

Vocabulary 

Text 

Presentation 


(Denotation/Connotation) 



SKILLS 


1.04. Listening 
1.05. Speaking 

1.06 Reading 

1.07 Writing 

*The Fundamentals of Literary Criticism*, Basil Blackwell, 
Oxford, 1974, ppl3. 



1.08 Literature 

1. 09 Stylistic Varieties 

1.10. Communicative Functions 

II BEHAVIOURS 

2.01. Knowledge 

2.02 Comprehension 

2.03. Application 

2.04. Evaluation 

2.05 Synthesis 

2. 06. Desirable Interests 

2.07. Attitudes 

2. 08. Personality Traits 

2. 09. Good Habits 

2.10. Communicative Skills 

IH CRITERIA OF ASSESSMENT 

3.01. Controlled. Response 

3.02. Correctness 

3.03. Appropriateness 

3.04. Fluency 

3.05. Intelligibility 

3.06. Spontaneity 

3.07. Creativity 

3.08. Enjoyment 

3. 09. Critical Awareness 

3.10. Appreciation 
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Language 


The place of English in India, seen in its wide perspec¬ 
tive of past, present, and future, is of crucial concern to any¬ 
one who attempts to write on the testing, methodology of teach¬ 
ing and content of teaching English at our institutes of higher 
learning. It has enjoyed a prominent place, rather a domina¬ 
ting position, in the area of higher learning. It has served as 
the medium of instruction both in technical and non-technical 
subjects. True, of late, Hindi and regional languages have 
stalled being used as an option with English but somehow it has 
not been possible to do away with English altogether. Whereas 
there is an oft repeated talk of the falling standards in Eng¬ 
lish, with consequent pleas for doing away with it, or consoli¬ 
dating its position by improving the standards, there are also 
claims for treating it as an Indian language. Some, for whom 
it is the first language, legitimately claim it as a native lan¬ 
guage. Its place as a link language and a language for official 
use still holds good. Nevertheless, it is likely to constitute a 
component of the academic process only as a foreign language, 
or at best as a second language, if its special place amongst 
foreign languages is to be emphasized. 

The teaching of foreign languages owes a great deal to 
the recent findings of Linguistics, Psychology, and Sociology. 
This is not to suggest that these disciplines exist for their use¬ 
fulness and meaningfulness in the domain of foreign language 
teaching, or for that matter, that foreign language teaching, 
or even language teaching, is an essential component of their 
fields of study. What it means is that these disciplines have 
drawn a lot from each other's findings and the teachers of 
foreign languages have been indebted to them, particularly to 
Linguistics, for evolving their goals and objectives of teaching 
and learning, for setting up the content area of teaching and 
learning, for a proper sequencing of the content, for evolving 
the strategies of teaching and experiences of learning, and for 
refining the tools and techniques of measurement and testing. 
Our concern here is primarily with testing, but in so far as it 
has a bearing on and is dependent on the other components of 
teaching and learning, an exclusive attention to it is well-nigh 
impossible. However, the acceptance of the totality of the 
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teaching-learning process as constituted of inter-related and 
inter-acting components is no reason to deny ourselves the 
choice of givingjfimphasis to a certain component and mention¬ 
ing others only in passing as it were. Our aln here is not even 
to deal with the whole process of language or English language 
testing for that matter, but to offer an illustrative model for 
further work and exploration. 

The first problem, then, that needs to be tackled is the 
problem of identifying and defining the content area. Time and 
again the phrase ’content area 1 instead of ’content* is being used 
to highlight its vastness, numericallty, and variety. Here at¬ 
tention may first be drawn to the generalized categories 
(1. 01, 1. 02, 1. 03) of Speech Features, Structure, Vocabulary 
Penotation/Connotation) as basic to language. They corres¬ 
pond to the technical categories of Phonology, Syntax or Gram¬ 
mar, and Semantics. A systematic description of language, 
taking cognizance of speech as its essential and prin ary com¬ 
ponent, exposing vague ^nd arbitrary statements about language 
and , in recent years broadening out into the area of psycholo¬ 
gical mechanism and communicative function of language, has 
certainly added to the reportoire of the teacher of languages to 
define and delimit his content systematically and scientifically. 

It is now commonplace to talk about language teaching and 
language learning as the imparting of or the acquiring of the 
skills of listening, speaking, reading, and writing. HereVe 
are adopting a psychological view of language; we are consider¬ 
ing it as a matter of individual behaviour. Whether we con¬ 
sider that behaviour to be a set of habits or possible responses, 
a body of knowledge, or a set of rules depends upon the parti¬ 
cular psychological account that we adopt of the language be¬ 
haviour of the individual and how it is acquired!* The in¬ 
stances of equating language skill with the mechanical skill of 
typewriting, treating the learning of a language as the mechani¬ 
cal acquisition of a skill in the production of its structural 
devices, are not lacking. In the words of Nelson Brooks, "The 
single paramount fact about language learning is that it con- 


PitCorder (s) ’Introducing Applied Linguistics’, Penguin 
Education, 1973: pp28 



55 


cerns, not problem solving, but the formation of habits. ,r The 
usage is reminiscent of the simple stimulus response associa¬ 
tive chain theories and has met with a lot of opposition but also 
acceptance by extension of its semantic potential. "These so 
called skills," says Pit Corder, "are categories of more or less 
overt linguistic behaviour. They classify observable physical 
acts, but neither describe nor explain what is going on inside 
the head of the language user," Pit Corder also treats the 
division of skills into ’active* and passive* (speaking and wri¬ 
ting/listening and reading) as founded on superficial thinking. 

He also points out that the tern s 'behaviour*, necessarily tied 
up with the idea of skills, and usually 'thought of as something 
essentially physical and observable', (pp. 106) does not do full 
justice to language. Most people think that a great deal of 
language activity goes on inside the head. He, therefore, pro¬ 
poses the terms 'productive and receptive performance* to 
substitute for the four skills. However, the linguistic litera¬ 
ture continues to use the terms ’skill*, by giving it added sha¬ 
des of meaning, like 'generative habit* or ’manipulative skill’ 
or 'creative skill', to take care of the productive performance. 
This is also an effort to integrate the theoretical constructs of 
transformational-generative theory of language into the beha¬ 
viourist constructs for purposes of language teaching. A dis¬ 
cussion of this here may shift the focus of attention. Suffice it 
to say that a superior organising mechanism must be postulated 
as the repository of 'rules' or 'generative* havits* to take care 
of the productive part of language as contrasted with automa- 
city. And this has to be postulated at all levels: phonological, 
syntactic and semantic . The nature of this 'superior mechani¬ 
sm* has not yet been fully explicated. What is of crucial con¬ 
cern to us, however, is that the term 'skill' can still be used, 
with the extended semantic range, for various reasons: 

a) It is familiar to a large number of our teachers. 

b) It has recently started finding a place in our 
syllabus designs. 

c) Our concern in testing is with the observable and 
measurable behaviour and what goes on 'inside the 

'Language and Language Learning*. New York, Harcourt, 
Brace and World, pp. 46^47- 
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head* is observable and measurable as it gets re¬ 
flected in the overt behaviour. This is actually 
the data with which the ’psychologists, as also 
theoretical linguists, must work*, as Pit Corder 
has put it. 

A coherent view oi the complex nature of language will 
involve the linguistic skills, mentioned ir discrete terms, but 
closely intertwined, a deep level of lingustic competence or 
generative capacity for novel speech, and communicative com¬ 
petence of functional properties and potential at different levels 
of social matrix. This brings in the problems of varieties of 
language, stylistic varieties, and a multiplicity of socio-cul- 
tural associations. Literature has a special place in the con¬ 
tent. Here complex of properties come into play in one form or 
the other and language is used for its own sake, to create an 
artistic artefact. There have been long debates on whether li¬ 
terature should constitute an important tern:inal point in all 
courses of language, or should be treated as a specialized area 
like all other specialized areas constituting the goals of foreign 
language or second language learning. Leaving the issue open, 
it may be pointed out that for an appreciation of literature a 
certain level of linguistic competence is absolutely essential. 

If it sounds vague, we may add that a near-native, if not native, 
level of linguistic competence, desirable for the native students of 
literature, is a pre-requisite. However, to use literature for 
purposes of creating enjoyable and interesting learning ex¬ 
periences with the objectives of teaching certain linguistic 
items is a different matter altogether. 

A closely tied up problem, particularly in matters of 
testing, is the question of the criteria of evaluation. An aware¬ 
ness of the different levels of language and its complex nature 
in terms of communicative functions and variety, poses the 
fundamental problems of correctness, appropriacy, fluency, 
intelligibility, spontaneity, and creativity. What is correct in 
one situation, or dialect, or style, may not necessarily be 
correct in another. 'Have it got two trees between the houses? 1 
is an illustration of a sentence marked correct in an enquiry 
game on the criteria of the user's (a Jamaican girl) dialect 
features and spontaneous speech. 'Wait while Monday', or 
'that belong to I', are instances of acceptable dialectal syntacti- 
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cal patterns. In our own situation, in ’the job offers good 
perks 1 , ’I saw some beautiful birds at the bird sanctuary’, and 
I have won a bet ’, the underlined words may be pronounced so 
close to ’parks’, ’bards’, ’bard’ and ’bat’ as to make any 
phonological distinction well-nigh impossible. Our dog may 
have to be 1 ’fed up* before we eat ourselves. We may tell 
someone ’hundred times’ instead of ’a hundred times’. We may 
’do the needful’ for someone instead of ’do whatever is neces¬ 
sary*. Our students may ’wish’ us in the morning instead of 
’greeting’ us. My friend might have done ’this all’ for me, 
even if I never ’wanted that this should be done’. We may 
’commit mistakes’ and ’what we could say to that*? We may 
say ’waist-thread* or *Kati-dora’, ’forehead mark* or ’bindi*. 

One of our students may help someone to go in a certain direction 
by saying, ’go, go, go, front, front, front’. Then there are varia¬ 
tions across specialized terminology but also in syntax. The use of 
types as marked in scientific discourse have often been pointed 
out. Particularly problematic are the vocabulary items with 
different ranges of meaning in common parlance, but with a 
specific different meaning in the technical sense in a certain 
area. There is the objective ’chronic* in medical terminology 
qualifying a disease of a continual, lasting nature, as opposed 
to ’acute’, but understood in common parlance as intense and 
severe. There is ’allergy’ in medical terminology referring 
to a condition of usual sensitiveness to something particular, 
but understood as dislike of sontething or somebody in the 
, common usage. References to ’stomach disorders’ as ’gipsy 
tummy’, or ’Tokyo trots’, to ’pregnancy’ as ’to be in a pudding 
club’, or ’to be in the oven’, and nearer home to death as 
’leaving for heavenly abode’, are instances of the existence of 
slangs, taboos and polite functional usages. 

A galaxy of vivid n etaphorical expressions acquire techni¬ 
cal significance in certain disciplines. ’Freezing of assets’, 
’ceilings on wages’, ’cold war’, and ’run-away inflation’ are 
some of the instances in social sciences. 

A fairly common phenomenon in our coffee-houses is 
somebody going over to another table with the question, ’Got a 
match?’ Interestingly if the person addressed sin.ply says ’yes’ 
or ’no* and that is all, the communication gap will be apparent. 
The communicative function of language, in terms of the theory 
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of communication as f who says, what, to whom, in which chan¬ 
nel, with what effect 1 , is a significant part of language learning 
Here is a situation in which the grammatical category of 1 in¬ 
terrogative 1 links to a request for a match to light a cigarette 
at the level of discourse, in the context of the speaker 1 s inten¬ 
tion by word and gesture, with a corresponding effect on the 
person addressed in handing over his lighter or match box. In 
a classroom situation, a teacher ! s question to a student, ’what 
are you laughing at? 1 may be interpreted as a communicative 
act of command or simply a desire to elicit a reply so that the 
other students could share the fun. It is this realization of the 
significance of communicative function of language that is 
responsible for shifting emphasis from mere grammatical 
competence to communicative competence with its performance 
potential. A communicative grammar relates grammatical 
structures systematically to uses, situations and meanings. 


Nothing has yet been said about the notion of fluency. 
Efforts have been made to evolve the criteria of fluency in 
quantifiable terms, but even those who have made such efforts 
have termed them only tentative. A reference in this context 
may be made to ’Fluency and Language Teaching 1 , Leeson 
(Richard), Longman, 1975, and ’Testing English as a Second 
Language 1 , Harris (David P.), Tata McGraw-Hill Publishing 
Company Ltd., 1974. 


The main purpose of this discussion of criteria of evalua¬ 
tion is to highlight the complexity of the concepts involved, the 
lack of rigorous definability, and hence the need for collective 
thinking by teachers to reduce the component of subjectivity in 
evaluation. These criteria also constitute the point of conver¬ 
gence of the goals of language learning and their evaluation. 
However, they have to be given specificity by the teachers them¬ 
selves. They are operative singly and in combinations over the 
whole range of the content area. For example, if the objective 
is the learning of spellings of vocabulary items, say, ’program¬ 
me 1 , ’theatre 1 , it will have to be determined, particularly in the 
Indian context if ’program’, ’theater 1 (American) will be treated 
as correct, and if in the same connected text ’program 1 and 
’theatre’ will be acceptable. 
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The criteria of creativity, enjoyment, critical awareness, 
and appreciation belong to the affective domain in the area of 
literature. They have been mentioned here only to stress the 
point that unless some overt and explicit parameters are evolv¬ 
ed to measure these components of learning, to put them up as 
goals may only be an exercise in redudancy. We will have 
something more to say about them in the course of our discus¬ 
sion of the testing of literature. 


After defining in broad terms the content area of 
teaching and learning language, it may be mentioned that the 
needs of pedagogy demand the principles of selection, grada¬ 
tion and presentation of materials to be used. These operative 
devices serve as a significant component in the preparation of 
text-books, consisting of one or a number of connected text/s. 
"Now there is a stronger tendency to treat linguistic reality as 
a social activity implying thereby that language is not merely 
a means of communicating through but is also a potent instru¬ 
ment of social control or service tool in the professional life. 

It is in this light that the new approach to second/foreign 
language teaching shifts the focus of attention. It is in this 
light that the new approach to second/foreign language teaching 
shifts the focus of attention from the formal grammatical to 
the functional communicative characteristics of a language. 
Language teaching is now being set against enabling learners 
to use the language for special purposes. " (Srivastava- R. N.) 
However, once the content area has been delimited for a speci¬ 
fic purpose, the learning behaviour in terms of terminal be¬ 
haviour to be attained at the level of parts and whole, and part 
to part and part to whole relationship, has to be carried out. 
The illustrative items being presented here are in terms of the 
conceptual framework mapped out in the checklist of objectives* 
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Literature 

The planning and organisation of syllabi in English litera¬ 
ture is based by and large on the personal preferences, likes 
and dislikes of those primarily entrusted with the task. Some 
sincere, progressive and forward-looking heads of departments 
do make some efforts to secure the involvement of as many 
teachers as possible, working in the university department and 
its constituent and affiliated colleges, while formulating cour¬ 
ses at various levels. However M in the absence of a systema¬ 
tic framework in the light of which the problems n ay be 
considered, the discussions range around the inclusion 
or exclusion of certain works, authors, component of 
language, Indo-Anglian writing, cultural component, literature 
in Indian languages, practical criticism, translation from 
English into an Indian language and vice-versa and so on. This 
has Its own bearing on teaching and testing. The problem can 
be met by clearly and specifically defining the objectives of 
teaching and learning English literature in the context of our 
situation. tf An educational objective is a statement of what stu¬ 
dents are to know, be able to do, prefer or believe as a conse¬ 
quence of being in a programme" 1 A checklist of instructional 
objectives, in terms of performance verbs,has been included 
in this monograph. In the framework of this checklist teachers 
can evolve the objectives of teaching English literature. This 
will make the task of measurement or testing, an indissoluble 
part of teaching-learning process, more realistic and syste¬ 
matic. "One of the strongest arguments for greater attention to 
objectives has come from those concerned with problems of 
assessment. There is now an increasing desire in higher edu¬ 
cation to design more valid instruments of assessment which 
measure what the teacher wishes to teach, but this can only be 
done once the teacher has specified his objectives. " (Natarajan 
V., Mimeograph). However, some teachers of arts and litera¬ 
ture are of the opinion that in arts and literature which demand 
creative responses, a clear identification of behaviours to be 
developed is not easy. Not only that, the learning outcome in 
these subjects should be unpredictable . "Reponse is a word 


1 . 


Goodland and Richter, ‘Towards a Mankind Curriculum: 
Adventures in Humanistic Education*, McGraw Hill Book 
Co., N.Y. 1974. 



64 


that reminds the teacher that the experience of art is a thing of 
our making, an activity in which we are our own interpretive 
artist. The dryness of schematic analysis of imagery, sym¬ 
bols, myth, structural relations, etal should be avoided 
passionately at school and often at college. It is literature, 
not literary criticism, which is the subject. "1 This seems to 
imply that a certain systematic pattern.of critical appreciation 
cannot be, or should not be, taught. This n eans to take away 
a loj from the teaching-learning process in literature. There 
are, however, scholars who regard only ’a small minority 1 as 
’capable of enduring such first-hand judgements of genuine 
personal response’ (Lavis, F. R., ’Mass Civilisation and 
Minority Culture’). The purpose of teaching literature is said 
to be the training of discriminating minds and only a few are 
capable of this level of discrimination. The emphasis is on 
careful and informed reading to attain the level of a discerning 
appreciation. 

In the midst of such controversies and interestingly 
divergent but in certaimways convergent stands, we have to 
ponder over what we actually tend to do in our classrooms by 
way of the interpretation of the prescribed areas of study for 
our students. No amount of high flown virtuosity of aiming at 
the inculcation of employment, critical awareness, apprecia¬ 
tion, and creativity will be valid unless the learners are in a 
position to show by overt behaviour, in explicit terms, the at¬ 
tainment of these implicit qualities. They are laudable general 
educational objectives, but only to be measured in tern s of 
performance. However, they are not taken up at this stage 
as a part of the system- of educational objectives. They are 
discussed here as terms in the system of criteria of evaluation, 
which examiners have to ponder over and def ine in order to 
eliminate the element of subjectivity in assessing the responses 
to long-answer questions. Literature lacks content in the sense 
of there being something out there to commit to memory as a 
fact. For example, a literary artefact, say a poem, of a play 
etc., does not expect as a response from the reader to be able 
to memorize and reproduce it on a proper occasion* True, 
children learn that way, particularly certain nursery rhymes, 

iSquire (J.H.) Ed., ’Response to literature’, Champaign, 

National Council of Teachers of English, 1968, pp.26. 
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and recitation even at a later stage is not altogether an unknown 
phenomenon. But liteasaiaire, in the process of teaching and 
learnii^, implies some sort of a response, an interpretation, 
an appreciation, and an evaluation. Enjoyment as a response to 
<& literary artefact necessarily ’iwolves a personal response. 
Enjoyment, being non-verbal cannot in itself form any part of a 
critique.** (Sparshot, I*- E ,, ’ The concept of critic ism 1 , Oxford, 
1967). Hewever, it is possible for one who ’enjoys 1 to be able 
to ^ay how much of ’enjoyment 1 it was and why one ’enjoyed 1 it. 
In this context then observations and statements in the nature 
of 9 think ilte jolly good poem’* f I think it is on a very relevant 
subject’, shea Id be partially acceptable - ’partially’ because 
what is involved here is the opposition of ’likeable’ and ’non- 
likeable’ and sot ’good’ and ’bad*. The latter terms are opera¬ 
tive in the system of evaluation and judgment. In so far as a 
statement of enjoyment is merely in the nature of a personal 
response* it does not preclude the possibility of a negative res¬ 
ponse to what has not been enjoyed, or what may be acknowledg¬ 
ed as enjoyable in common literary perlance. ’I think this poem 
is in bad taste, * ’I don’t like this poem, ’ *1 find ’King Lear’ 
boring' and so on, are the statements to be, by implication, 
included under enjoyment. 

Since critical power Is inseparable from personal ex¬ 
perience, it is natural to raise the question, ’Can it be taught? 1 
One must admit that in the strictest sense it cannot be. A man 
whose ear is deaf to all the tones of literature cannot be caused 
to hear. But most ears can be trained, that is, encouraged to 
discover a more discrin mating response to a wider range of 
literary experience, so that small but vital clues will be notic¬ 
ed, leading to perceiving how this poem or novel can be read. 
So that relevant questions can be asked. In this process it is 
Important to start where the reader is, so that the individual’s 
complicity in the expansion of reading can be preserved”. 
(Hunter,C. K., ’English’, Routaledge & Kegan Paul, London). 

A discriminating response demands a conceptual frariiework, a 
characterization in terms of systematically ordered concepts 
for an empirical analysis. ’’Enjoyment that proceeds from 
understanding is called appreciation. To appreciate music in 
general is to be able to derive from music the enjoyment that 
an understanding of music, and hence of what musical skill has 
put there to be enjoyed, can yield”, (^arshott, F. E., pp. 
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113-114). Appreciation, in terms of explicitly stated and well- 
defined concepts, putting the examiner and the examinee in 
communication, is possible only if examiners give a serious 
thought to it. "How... . are we to in prove our mode of under¬ 
standing? One way is to recognise the character of critical 
divergence: to set individual views side by side, to note the 
pattern of variation, cause of divergence. In its turn, this 
would show beyond doubt that divergences are of different quali* 
ties, and a recognition of this would be a recognition of quali¬ 
tative degrees of value and of communication in the different 
works considered. "1 If this is true of evolving a pattern of 
response to a literary artefact, it is also true of evolving a 
pattern of response to an examinee's answer. 

It is, however, true that sometimes an examinee may 
surprise the examiner by a certain sense of originality, which 
may imply words, phrases, sentences, ideas etc. brought into 
new and novel relationships. It is in this sense that the con¬ 
cept of creativity as a criterion has been introduced. It is not 
creativity as a part of content, training in or learning to write 
poems or short stories. The two should not be mixed up. How¬ 
ever, the concept remains fluid, despite all sorts of definitions 
given to it. It is, therefore, important that if it is to serve as 
one of the criteria of evaluation, every effort should be made 
to arrive at an agreed framework, if not a definition. 

The concept of critical awareness need not be mixed up 
with the idea of a blurred or hazy sort of impression of the 
critical jargon, or the critical work of others on the same li¬ 
terary artefact. It actually refers to the knowledge and under¬ 
standing of critical theory, critical scholarship, and cultural 
component - concepts that have a bearing on the appreciation of 
a literary artefact. Of course, culture here is understood in 
-the sense in which Raymond Williams has projected it (conclu¬ 
sion to ‘Culture ~nd Society' 1780-1950, London, Harmondson, 
Pelican, 1961): the ongoing construction of values, beliefs, 
ideas and assumptions within the central social institutions of 
work, education and the family, as well as in the arts and the 
media. Culture, then, does not imply the best that has been 

1 Hobsbaum (Philip), *A Theory of Communication*, 

Macmillan, 1970, pp. 162-163. 
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thought and said. In the more anthropological sense it implies 
the means by which the groups express their relationship with 
the environment. In this central context* if ’how do you do?’ 
does not demand a response of reeling off the diseases one 
suffers from* it is only a matter of functional social or cul¬ 
tural manifestation of language. An illustration that immedia¬ 
tely comes to mind is the first meeting between Aziz and 
Mrs. Moore in E. M. Forster’s *A Passage to India’. 


’’Suddenly he was furiously angry and shouted: 

’Madam'. Madam’. ’ 

’Oh*. Oh*. * the woman gasped. 

’Madam, this is a mosque, you have no right here at all; 
you should have taken off your shoes; this is a holy place 
for Muslin s’. 

*1 have taken them off’. 

'You have?' 

'I have left then at the entrance.' 

’Then I ask your pardon. ’ 

Still startled, the woman moved out, keeping the ablution tank 
between then.. He called after her, 'I am truly sorry for 
speaking.' 

’Yes, I was right, was I not? If I remove 
my shoes, I am allowed?’ 

'Of course, but so few ladies take the trouble, 
especially if thinking no one is there to see. ’ 

'That makes no difference. God is here. ’ 

'Madam'. ’ 

’Please let me go*. 

’Oh, can I do you some service now or at any tin e?' 

'No, thank you, really none - good night. ’ 

’May I know your name?' 

The socio-cultural differences implied here are reflected 
in the adverbial 'furiously' in Aziz's n ode of address to a 
woman and, then, offering a very curt and inadequate apology. 
Moreover, in the very first meeting, despite her irritation, to 
get to know her is against the normal British culture. But, then 
Aziz is an Indian, and an Indian cf the days of the British 
empire. Foster is trying to give him a language in that context 
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and not to make him look boorish as some of our adherents to 
British norms of correctness would have us believe. However, 
this is only one way of looking at it, and acknowledging that 
there may be many more is simply repeating the plea for an 
effort to evolve as objective a framework of evaluation as possi* 
ble - how much of cultural information will be required? 

To sum up this, I may point out that some of the problems 
can be taken care of by introducing a certain percentage of ob¬ 
jective type items into the question papers. Some element of 
subjectivity, held as sacrosanct in an approach to literature, 
may be analogously granted to the examiner as well. Criticism 
is an abstract term for various components: enjoyment, appre¬ 
ciation, evaluation (in the sense of good and evil), socio-eco¬ 
nomic factors impinging on a literary artefact, creativity (in 
the sense of a critic being an artist or a creator) etc. It is 
marked by a variety of tools and techniques. If it can be de¬ 
limited for pedagogic purposes, it will attain functional clarity. 
In so far as it is subjectively done by a teacher, it justifies 
the need for it. In so far as it can be systematically done, it 
only demands thinking in terms of objectives of learning. Our 
next step, then, is to offer some illustrations of testing by 
objectives. 


I 
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Illustrative items /quest ions 


1 You will hear three sentences. Two of them are the same. 
1 In the space provided in the booklet you have to indicate the 
letter of the one that is different. 


2 

1 

3 

1 


A. I saved him 

B. I shaved him _ 

C. I saved him / / 

A. This is a .school for tiny tots 

B. This is a school for tiny tots _ 

C. This is a school for tiny dots / / 

A. Mohan needs the newspaper in the morning. 

B. Mohan reads the newspaper in the morning. 

C. Mohan reads the newspaper in the morning, j—-j 


4 One of the sentences you just heard is the answer to the 
2 following question: 

What does Mohan read in the morning? 


Choose the number of the sentence from the given list 
and put it down in the space provided. 


A. 1 B 

B. 2 B _ 

C. 3 B / / 

5 Mention the grammatical form of the following sentence, 

3 Writing A for Interrogative, B for Statement, _C Im¬ 

perative, J^for Exclamation: 

5. 01. Mohan goes to the office in his car. 

5. 02. Mohan’s car is out of order these days. 

5. 03. How is Mohan going to the office these days? 
5. 04. Mohan is going to the office by bus these days; 
5. 05. Mohan usually gets up at six o’clock. 

5. 06. Mohan is getting up at five o’clock these days. 
5. 07. How smart! 

5. 08. I am picking up Mohan on the way today. 

5. 09. Come with me. 
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§. State the tense and aspect of the verbal groups In the 
3 sentences under 5. 

Write A for Simple Present Tense, B for Present 
Progressive _C for Zero Verbal Group. 

7 Given below are some of the verbal groups from the 
3 sentences under 5: 

goes : is going 

gets up : is getting up 

The statement of the formal difference here may be made 
as follows: 


Verb + S : be + Verb + ing 
(baseform) (baseform) 

The functional difference between the sentences in which 
these verbal groups occur may be stated as 


A. Zero difference 

B Habitual activity in the Temporary activity in 
present time: the present time. 


C Temporary activity in 
the present time: 


Habitual activity in 
the present time. 


LJ 

8 Answer the following questions from your knowledge of the 
2 sentences given under 5. 


How does Mohan go to the office? 

How is Mohan going to the office these days? 

9 Choose the appropriate question from the alternatives to 
3 which the following sentence will be the answer: 


Mohan gets up at six o'clock every day. 


A When does Mohan get up every day? 
B How does Mohan get up every day? 



73 


C Does Mohan get up at six o*clock every day? 

* LJ 

10 Choose the appropriate form, from the alternatives, of the 
3 combination of the following sentences: 

Mohan goes to the office in his car. 

Mohan is going to the office by bus these days. 


A Mohan goes to the office in his car, and he is 
going to the office by bus these days. 

B Mohan goes to the office in his car, but he is 
going to the office by bus these days. 

C Mohan goes to the office in his car, but Mohan 
is going to the office by bus these days. 

LJ 

U Ahmed is at Point A. He gets to point C. His movement is 
34 shown by arrow marks. With the help of the base forms of 
the verb given, describe his movement, using Present 
Progressive Aspect. 



WG indicates the following. 

3 

10 is the serial number 

3 is the number indicating the listed behaviour in checklist 
In p. 35. This is Follow/conventions behaviour. 
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12 Ahmed may be said to have arrived at Point C. From 
34 Point C he has to get to Point D. Show his movement with 
the help of the base forms of the verbs given. Ahmed has 

arrived at 
point D. 



13.01 


8 looks bigger. 

A has grown bigger 
B grows bigger 
C is growing bigger 

LJ 

A. has enlarged 
B Is enlarging 
C enlarges 

LJ 

14 Listen to the dialogue between Neeraj, a student, and 
3 Mr. Lai and answer the questions that follow: 




1 . 

Neeraj 

: Mr. Lai, could I see the Principal 
for a while? 

2. 

Mr. Lai 

: May I know your business, please? 

3. 

Neeraj 

: I want to ask his permission for a 



picnic. 

4. 

Mr. Lai 

If youHl just wait here. I’ll inform 
him 


Yes, you can go in. 
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the grammatical type of sentence I? 

Statement 
Imperative 
Interrogative 

- Exclamation /_/ 

15 What function does sentence I perform? 

3 

A Of a request for permission 

B Of an insistent demand 

C Of a request for information /_/ 

15 Continue the dialogue, writing at least one sentence in the 
34 blank: 

Principal : 

Neeraj : 

Principal : 

Neeraj : 

Principal : 

Neeraj : 

Principal : 

17 Knowledge of the conventions of mechanics of writing. 

3 

Punctuation 

1. Choose the form that conveys the meaning given in 
brackets. 

(The speaker has come early but his reason for 
doing so was not to cause inconvenience.) 

a. I did not come early because,I thought it might 
inconvenience you. 


What is 

A 

B 

C 

D 
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b. I did not come early because I thought it might 
inconvenience you. 

c. I did not come early, because I thought it 

might inconvenience you. __ 

LJ 

2. (The speaker has only one wife) 

a. My wife, who is a doctor has gone to America. 

b. My wife, who is a doctor, has gone to America. 

c. My wife who is a doctor has gone to America. 

LJ 

3. (The person addressed may not like any.) 

a. Would you like Nath, or Sharma, to go with 
you? 

k* Would ypu like Nath or Sharma to go with you? 
c. Would you like Nath or Sharma, to go with you? 

LJ 

18 Knowledge of the conventions of formal and informal func- 
3 tions of language: 

Father 
Daughter 
Father 

Daughter 
Father 

Daughter 


: When is the train due to leave? 

: At 10.15 

: Why don't you ring up the station 
and confirm it? 

: I did. 

: Who did you speak to? Are you 
sure you didn't misunderstand 
him? 

: The man to whom I spoke was 
quite definite about time. 


Father feels very annoyed because 

a. his daughter is rude to him 

b. his daughter has disobeyed hr 

c. he is still not definite about time 
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19 Knowledge of the conventions of cultural functions of 
3 language. 

A British teacher, having come to India recently, 
is highly pleased at the following sentence used by a student 
in a paragraph: 

"In an examination I sit in a room I vomit all that 
I learned on to the paper". 

What pleased the teacher so much was 


a. 

the student*s correct usage of English 

b. 

the freshness of expression 

c. 

the depth of the student* s understanding. 

LJ 

20 Knowledge of the conventions of situational constraints 
3 language: 

A. 

Come, let*s go for a walk. 

B. 

Come, let*s go walkies, 

A and B may be said to be 

a- 

in free variation 

b. 

different in style: formal/informal 

c. 

involving different participants 

LJ 

21 Knowledge of the conventions of cultural function of 


3 language: 

A foreigner, visiting England, is invited to a 
cocktail party. Walking to the house where the party is 
to be held, he meets a girl he knows and he takes her with 
him to the party. On arrival at the party he tells his 
hostess that he has brought with hin. a girl he has met on 
the street. The hostess feels shocked. 

The hostess feels shocked because the foreigner 
a. has brought an univited guest 
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b. has committed some grammatical error 

c. has been rude to the hostess 

d. has uttered some unbecoming words 

about the girl. __ 

/_/ 

BASED ON TAGORE*S 'BABUS OF NAYANJORE 1 

1 I saved him. 

State the tense and aspect of the verb in the sen¬ 
tence. Write A_ for Sin pie Present, JB for Sin pie Past, 
C Present Progressive. 

/ / 

2 Listen to the dialogue that follows. You are required to 


mark the tense and aspect of the verbal groups. Write A 
for Sin.pie Present, B_ for Simple Past, C_ for Present 
Perfect. 

A run : 

Tagore disliked Kailas Babu 

/_ 

j 

Bala : 

Why did he dislike him? 

r 

7 

A run : 

Because he used to fancy that 

Kailas Babu looked down up him. 

L_ 

7 

Bala : 

Did Kailas Babu's other friends 
show a similar feeling? 

L_ 

7 

A run : 

No, they did not • They rather 
liked Kailas Babu 

r_ 

7 


3 Put the verbal groups in brackets into Simple Past Tense: 

3 

Tagore (pride) himself on being a self-made man. 
He (hate) Kailas Babu ? s false sense of prestige in the name 
of his family. He (not approve) of the false stories that 
Kailash Babu (narrate) about the glory of his family. Kailas 
Babu ! s other friends (enjoy) these stories. 

£ Combine the sentences under 2 so as to make it into a 
24 paragraph. 

5 Answer the following questions with the help of the given 
33 
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cues, putting the verbal groups given in brackets in 
Simple Past Tense: 

(i) Did you read this morning’s newspaper? 

(Cue : No,_ _(cannot read)_ 

(ii) Why could not (couldn’t) you read it? 

(Cue : _(get up)_ 

(iii) Do you usually get up late? 

(Cue : No,_(be) rather unusual_ 

(iv) How did you manage to reach the college for 
the class in the first period? 

(Cue : 

a. (dress) hurriedly 

b. mother (lay) breakfast_table 

c. (gulp down)_ 

d. There (be) no time_ 

e. (has) to rush 

6 Frame question to which the sentences under 5 (iv) could 
34 be the answers. 

7 Think of a situation when it was raining. You were keen 
36 on going to the university. You had given a word to your 

friend. Your mother did not like the idea. However, you 
went. Narrate your experience. 

a. Decide if the experience was funny/sad/ 
adventurous. 

b. Use descriptive words to show the condition 
of the roads. 

c. Use Past Tense /Past Perfect/Past Progres¬ 
sive Aspect. 

d. Remember you are to describe a personal 
experience 

e. Write 250 words. 
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* THE SILVER LINING’ 

^ ^ Chaman Nahal 

It is difficult to assess the range and quality of human 
emotions. Those with smiling, evergreen faces may have 
wormlike griefs gnawing at their existence, and a dull, idiot'e 
looking person may be blissfully happy. Life is a strange, 
humdrum affair, where even a few moments of peace snatched 
should probably be gratefully acknowledged. 

I had recently the very pleasant experience of staying at 
a private Guest House in one of the hill-resorts. A friend of 
mine had earlier warn.ly recommended the place to me, clai¬ 
ming for it all the facilities which most of these boarding¬ 
houses advertise but generally lack. It was centrally situated- 
close to the post-office, close to the market, close to the bus- 
stand— and was yet isolated and away from the common din. 
There were pleasant views to be had from there, it had an 
excellent cuisire, atid was well looked after by one of the most 
charming hostesses one could find anywhere. 

1.2 


I discovered that the place exactly corresponded to the 
details described. But it was the hostess, particularly, and 
her husband and their little daughter who really proved to be 
the centre of attraction to me. 

The lady belonged to the South, though she had married 
a North Indian . She was rather dark, but had a very pleasant 
fac6, all smiles and kindness. The husband was a huge, swar¬ 
thy man, with large, bony lin bs. He was extremely well- 
mannered a, d there was not a trace of that untempered rough¬ 
ness which one finds in most men hailing from the North . 

1.3 


Mrs Bhandari, the landlady, took me in hand the moment 
I arrived. She looked after my luggage, gave instructions 
regarding my room, had a cup of delicious co f fee improvised 
in no time, and then put me at my ease by talking to me in¬ 
formally about myself and my visit. I was completely woq over 
by the family. It appea red as if I had known them for years . 



81 


1.4 


While thus chatting with the two of them, I became aware 
of the slightly-built girl hiding behind the settee. She must 
have been about eight, and was sweet and charming like her 
mother. Her hair was closely cropped, with a straight fringe 
across the forehead,in Chinese fashion. She was in jeans and, 
in her half-sleeved loose jersey and high boots, looked a mini¬ 
ature jungle queen. But she was behaving a bit too timidly for 
one, and was trying to avoid me . 

1.5 

I couldn't help si iling. I saw that she w r as staring at me 
1 said, 'What's your name? 1 and beckoned to her to come to me. 

The girl became immediately self-conscous, shook her 
head, and stood where she was. 

I called once more, "Hello"! Come here, my dear. ' 

She blushed and again shook her head. After a second, 
she ran out. I thought I saw tears in her eyes. 

2.1 


I suddenly became aware of an awa ! "ward pause in the 
room, and, turning to Vok at the Bhandaris, I discovered that 
both of then were frowning , a painful look bn their faces. 

Mr Bhandari squeezed the arm of his wife, and said, apologeti¬ 
cally , 'I’m sorry, Mr. Dhanda. You see, our daughter cannot 
hear anything, nor speak. That f s why she didn't come to you. ' 

I gasped and muttered something about being sorry . I 
became confused and did not know what more to say. For I was 
feeling ashamed at my forwardness with a child who was ob¬ 
viously not in a position to respond to mv overtures of friend¬ 
ship. I vaguely felt I had wronged her and her parents. 

2.2 


It did not take me long to see that this was a situation the 
poor parents had to put up with almost daily. For every day 
one or two guests left and new ones came along. And, at the 
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very first meeting, or soor afterwards, they would run into the 
child, be fascinated by hex charm and beauty, and want to talk 
to her, to pat her, and so on and so forth. And every time it 
would result in the child silently smiling, sighing and with¬ 
drawing, leaving looks of agony on the faces of her parents. 
Often, it would lead to lengthy explanations as to how the 
calamity had come about, for many of the inquisitive visitors 
liked to know if it was from birth, or the result of an accident; 
whether anyone else in the family suffered from a similar dis ¬ 
ability; and if any treatment was being given. 

2.3 


The queries were answered by the parents haltingly and 
with obvious anguish. What struc;; me as the worst part of the 
situation was that the girl would be often gravely looking on, 
her eyes aghast with horror and self-pity , aware that she was 
the topic of discussion . She had no other pastin e than to run 
around to house, or play with the servants. She did not go to 
school, as there was none there to cater for her needs. They 
had tried to teach her at home, but without success. She could 
only hear faintly, without feeling much, when one shouted close 
to her ears; and she could speak nothing except utter aninial- 
like cries of happiness and sorrow ; or say crudely such words 
as ’ma-ma* or 'unc-ll 1 . All her other communications were 
confined to gestures with her hand, which brought a fleeting 
sensation of torture to her whole being when one failed to follow 
what she was saying. 


3. 1 

To save the child from such repeated humiliation, I one 
day suggested something to the Bhandaris which the parents, 
after some trepidation, agreed to try . We decided to have bits 
of paper typed, and to hand over one of these chits, duly sealed 
in a cover, to every new visitor as soon as he entered the finest 
House. The text of the chit ran: ’Our daughter is deaf and dumb 
You may hurt her by trying to be friendly too soon , as she can 
neither understand nor reply to your kind words. You are re¬ 
quested to please give her tin e to approach you and make you r 
acquaintance . Thank you. * 
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3.2 


A line to the effect that they might be spared questions 
about her w as removed by Mrs Bhandari on the plea that it 
would not be compatible with her spirit of hospitality . As it 
was, she felt the note was not a very kind one to be given to 
people who were going to make her Guest House their tempo- 
rary home. But she gave consent to save the girl the untold 
misery and helplessness she experienced every time a stranger 
approached her. 

The ruse worked well, even beyond our expectations. 
Though a few sympathetic questions were still put to the pa¬ 
rents, the poor child was spared. Later, the girl herself 
slowly became intimate w ; th many of the guests. The Bhandaris 
felt relieved, and thought that at least one of their problems 
was temporarily solved. 

3.3 


But they had a strange visitor one day. 

It was late in the afternoon and I was talking to the land¬ 
lord about some packed lucnh that I needed the next day—I was 
planning a short excursion, by myself, to a group of cave s 
nearby . The landlord was in a hurry, arranging things for a 
new guest who had booked a room for the season and was sup¬ 
posed to be moving in any moment—arriving by the Mail train 

3.4 


A-ri sure enough, soon, a young man came in, a porter 
carrying his luggage. He was barely twenty-five, clad in an 
ill-fitting tweed suit , with drooping shoulders a^d wide trouser- 
bottoms. Because of the journey, he looked untidy, his hair, 
his necktie, his shoes— all unkempt and needing attention. But 
he had a cheeful face and jet-back eyes sparkling with vitality. 

Mr. Bhandari stepped forward and asked, 'Mr. David, I 
presume? 1 

The young man looked closely at his face, smiled and 
nodded. 

♦Room No. 18, please. Everything is ready. * 
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3.5 


The young man again looked at him, smiled and nodded. 
He paid the porter, who bowed low—for he was not asked to re¬ 
turn the change— and disappeared. The young man gave me a 
brief, friendly look and sat before a huge book, which the land¬ 
lord had pushed before him, making the necessary entries 
about himself and his intended stay. 

At this time, he discovered the sealed envelope con¬ 
taining the typed chit lying on the table, addressed to him by 
name. He took the cover and tore it open. This coincided with 
the entry of the landlady into the room. She hurriedly asked 
her husband if this was the new guest, and, having received 
confirmation, came forward and shook hands with the young 
man. 

3.6 


f Did you have a nice journey, Mr. David? 1 she asked, 
with her sweet smile. 

Ihe young man smiled and nodded nonchalantly, as if to 
say, ’Well, neither very pleasant nor very unpleasant. 1 

’Would you like to have a hot bath immediately or tea 
first?’ 

The young man pursed his lips and shrugged his shoulders 
obviously implying that one would be as good as the other, and 
that he had no preferences. 

4.1 


Both the landlord and the landlady were by now slightly 
disconcerted by what they inferred to be their guest’s pride and 
arrogance , since he had not even deigned to reply adequately to 
their polite enquiries. 

The young man, meanwhile, took out the typed chit and 
started reading it. As soon as he had gone through it, he looked 
around, astonished. The little girl, Promodni . was at the 
moment playing in the courtyard. We could see her sitting 
near the flower-beds. The young man looked at all of us with 
a smile, and darted out towards her. 
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’Now this is very strange!’ Mrs Bhandari cried out in 
protest. ’How rude he is ! ’ 

’He shouldn’t have ignored our request like this, ’ the 
landlord put in, more mildly. 

I, too, was a bit upset . F >r it was obvious that our 
effort to save Promodni en barrassment from strangers was 
going to fail in this instance. 

4.2 


After a few moments, we all walked out to the verandah, 
and I was apprehensive of that impending look of anguish on the 
faces of the parents and the child. 

The scene that confronted us was something we least 
expected to see. 

Hie strange young man was reclining on the grassy 
ground and Promodni was sitting on his lap . He was showing 
her the flowers. 

And suddenly, like the sound of a gun exploding, the 
shrill animal-like laughter of Promodni pierced the air-. 

The parents looked at each other with wonder and amaze¬ 
ment. 

’Our daughter has not laughed like this for years! ’ 

Mrs. Bhandari said. 

4.3 


Curious, we watched the two of them who were now walk¬ 
ing towards us hand in hand. Promodni ran to her mother and 
danced about her with joy. She made her queer sounds of 
*ma-ma! ma-rna! * and wildly pointed to the young man. 

It was Mr. David who came to our rescue. 

We soon realized that he was deaf and dumb , too! 

His strange, ambiguous silences, his sudden rush for 
the girl on reading the note—all became instantly clear to us. 

It took us tin e to digest the news. And then, both parents 
broke into incoherent statements of profuse apologies that they 
had not noticed it earlier. Imagining the type of man they were 
talking to, they spoke in half-sentences and tried to convey the 
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rest through gestures. But the young man had not the slightest 
difficulty in understanding them: he appeared to read their lips. 
He gracefully acknowledged their warmth and either nodded or 
shook his head in reply. For more complicated and lengthy 
answer he used pen and paper. 

4.4 


The next day, Mrs. Bhandari was full of news. She 
talked as she had never talked before: She mentioned the 
stranger and the plans for the betterment of Promodni he had 
outlined to her and her husband. There were schools for such 
people, he had told them, though they were beyond most 
people*s means. He had himself been educated in one such 
institution abroad; and had now returned to India to render the 
same useful service to others, by starting a school here. She 
almost brooke down with gratitude when she said that he had 
agreed to accept Promodni as his first pupil. He had emphati¬ 
cally stated that the girl could, in course of time, live almos t 
as normal a life as any ,one of us who had the powers of hearing 
and of speech. 

Mrs. Bhandari laughed like a carefree girl. She gave 
us an extra helping of jam and butter and honey at the table. 

S he looked the happiest woman in the world. 

1 Moral refers to 
3 

A. An explicit lesson 

B An extract from a religious book _ 

C. The action of the good characters / / 

2 Setting refers to 
*3 

A. The main idea 

B The location _ 

C. The sequence of events / / 

3 Closeness to the post office, market, and bus-stand made 

1 the guest house_. 

4 Distance from the common noise made the Guest House 
1 
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5 The structure of the whole story may be analysed into three 
14 component parts: 

Presen t Past perfec t Past 

Serves the function Serves the function Serves the 
of a moral of providing the set- function of 

ting to the guest narrating the 

house events and 

experiences 

In which of the following is the moral of the story clearly 
pointed out? 

A. Life is a strange, humdrum affair. 

B. It is difficult to assess the range and 
quality of human emotions 

C. A few moments of peace snatched in 
life should be gratefully acknowledged. 

6 The total effect of the central situation of the Guest House, 
14 Its isolation from the common din, cuisine, pleasant 

views, and a charming hostess was that of 


A. 

Adventure 

B 

Comfort 

C. 

Boredom 


7 Reference 1.4 to 2.1 
26 

This part of the story may be said to deal with Mr. Dhanda's 
first meeting with Promidini. It may be analysed into four 
parts: 


Part 1.4 to 2.1 


Conclusion about Illustration Explanation Emotive res- 

the glrl # s charac- of her beha- of her beha- ponse of Mr. 

ter viour viour Dhanda 

Explain in 100 words the relationship of the parts, putting 
them in a logical sequence, if desired. 
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The dominant mood of this part of the story (1.4 - 2.1) Is 
** that of 

A. Delight 

B. Sarcasm _ 

C. Pathos L _/ 

Given below is a list of some words and phrases that are 

11 related to the mood of pathos in this part of the VJpry. Only 
one word does not stand in the relationship. Marfc^the word. 

A. Painful 

B. Frowning 

C. Was feeling ashamed 

D. Sorry 

E. Wronged 

F. Tears 

10 Mr. Dhanda*s response may be said to be a sense of 
14 

A Guilt 

B. Relief 

C. Horror 

11 2.1 

12 

Mr. Bhandari's reason for being apologetic in giving the 
information may be 

A. his sense of guilt 

B. his spirit of hospitality 

C. his awareness of Mr Dhanda's ignorande. 

£7 

12 Reference 4.4 
26 

Write 50 words about why Mrs. Bhandari "gave an extra 
helping of jam and butter and honey at the table. M 

15- Reference 3.1 
27 

You are requested to please give her time to approach you 
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and make your acquaintance. Thank you. 

Choose the appropriate alternative of the polite conversa¬ 
tional form of the sentence: 

A. Give her tin e to approach you and make 
your acquintance 

B. Could you please give her tin e to approach 
you and get to know you ? 

C Please give her time to approach you and 
make your acquaintance. 

11 Narrate in 50 words the scene of Promodini and David 
25 upio the time everyone realized that David was deaf and 

ctemb. 

i§ i *ft is difficult to assess the range and quality of human 

21 emotions. Those with smiling, evergreen faces may have 
wormlike griefs gnawing at their existence, and a dull. 
Idiotic - looking person may be blissfully happy. Life is a 
strange, humdrum affair, where even a few moments of 
peace snatched should probably be gratefully acknowledg¬ 
ed 1 ! 

Write an essay of 450 words to show the appropriateness 
or otherwise of these opening remarks of the story to the 
events and experience of the story. 

11 The author of the story has by implication remarked that 
35 there Is inadequate provision for the education of disabled 
children in our country. In the light of the availability of 
resources, manpower, educational and social priorities, 
make out a case for promoting the cause of .education of 
disabled children. Write 200 words. 

11 Mr. David has "a cheerful face and jet-black eyes spark- 

22 ling with vitality." 

Write 100 words about Mr. David’s character, keeping in 
dew the fact of the disability he suffers from. 
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'BORES' 

E. V. LUCAS 

It requires a sense of superiority, assurance and self- 
confidence to write about bores at all, except as one of them. 
But since your true bd£e'is always unconscious of his borish- 
ness, and indeed usually thinks of himself as the most com¬ 
panionable of r6en, to'Wrrfe ^‘ Oi?d of them is to acquit oneself 
of the stigma. * 

^ ^ m- ■ 

None the less, at some time, I ?ear, everybody is a bore, 
because everybody now and again has a fixed idea to impart, 
and the fixed ideas bf the few $re the boredom of the many. 

Also , even the least self-centred of men can now and then h^ve 
a personal experience sufficiently odd to lose its true propor¬ 
tions and force him to inflict it qyej^much on others. But bores 
as a rule are bores always, for^egptl^m is beyond question the 
bore's foundation-stonei.his bp!|pf being fhat what interests 
him and involves him sept as .^central figure must interest you. 
Since he lives all the all the t tjme something is hap¬ 

pening in which he is the central figure,hag always some¬ 
thing new to discourse upon: Himself, his house, his garden, 
himselfjhis wife, his children, himself, his car, his handicap 
himself, his health, his ancestry, himsel^^e grange way in 
which, without inviting them to, ..afjC funds of confide in 

him and ask his advice, his humorous way witluwa£ters, his 
immunity from influenza, his'*travels, the instinct which al¬ 
ways leads him to the best restraurar$g, r his dentistr^is free¬ 
dom from shibboleths, he being one ofithoaa.r^en who look upon 
the open air as the best church, his possible ignorance of the 
arts but certitude as to what he himself likes, his tru^oighs 
over the income-tax people. These are the happy men, 4&is 
word's axle-trees. - -••••.«’ 

(I have been referring to bores exclusively as men* Whe¬ 
ther that is quite just, I am not sure; but I shall leave it therqi. 

CONSTANT ALTERNATIVE 

1 A true bore is a man who never realizes that he is 
10 a bore. 




91 


A bore is not always self-centred. 

One writes about bores only when one regards 
oneself as superior to them. 

The personal experiences of others usually in¬ 
terest a bore. 

A bore regards himself as a very friendly person. 

UE STION/COMP LE TION 

How can one save oneself from the charge of a 
sense of superiority in writing about bores ? 

What does a bore think of what interests him? 

A true bore is always unconscious of his_, 

4 The boredowm of many is the result of the_ 

4 ideas of some. 

MULTIPLE CHOICE/FACET 

1 The author's justification for writing about bores 

10 is that he 

a. regards himself as superior to them 

b. thinks of bores as sociable men 

c. partly accepts himself as a bore 

2 A real bore is a man who 

10 

a. always unconsciously talks about himself 

b. is very confident of himself 

c. makes friends easily 

d. is a good conversationalist 

3 ’Egotism* means 
8 

a. talking effectively 

b. talking about oneself 
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c. finding others friendly 

d. making others happy 

.1 Rearrange the following so as to establish a proper 

6 sequence of ideas: 

a. But true bore is always unconscious of being 
a bore. 

b. Everybody is a bore in a certain sense of the 
word. 

c. His basic characteristic is the practice of 
always talking about hin self and his experienc¬ 
es. 

d. It is quite possible for a man to occassionally 
lose the sense of balance in talking about one 
of his odd experiences. 

SHORT ANSWER 

"1 In what sense is everybody a bore? Mention the characteri~ 

25 sties of a true bore and distinguish them from the sense in 
which everybody is a bore. Write 50 words. 

MATCHING 

1 Under A are given some words and phrases from the pas- 

18 sage. Match them with their meanings from amongst the 
items given under B. 


A B 


1 . 

Self-centred 

a. Without doubt 

2. 

Beyond question 

b. Talk at length 

3. 

Central figure 

c. Interested mainly in 


oneself. 

4. 

Discourse upon 

d. Fearless 


e. Discuss 

f. Main person 

g. Force on 



LONG ANSWER 

1. Think of an occasion when you were at a party. There you 
35 met a man who talked only about himself. You were fed up. 
You played a trick to get away from hint. Write an essay* 
in about 450 words, on the incident. 


NO ROAD 

Philip Larkin 

1. Since we agreed to let the road between us 

2. Fall to disuse, 

3. And bricked our gates up, planted trees to screen us. 

4. And turned all time's eroding agents loose, 

5. Silence, and space and strangers - our neglect 

6. Has not had much effect. 

7. Leaves drift unswept, perhaps; grass creeps unmown, 

8. No other change. 

9. So clear it stands, so little overgrown, 

10. Walking that way tonight would not seem strange, 

11. And still would be allowed. A little longer, 

12. And time will be stronger, 

13. Drafting a world where no such read will run, 

14. From you to me; 

15. To watch that world come up like a cold sun, 

16. Rewarding others, is my liberty. 

17. Not to prevent it, is my will’s fulfilment. 

18. Willing It, my ailment. 

H TEACHING MATERIAL : The planning involves 

i) a general approach to the subject; 

U) specification of instructional objectives; 
ill) choice of some well-defined tools for an overt 
response; 

iv) tools for assessment; 

v) criteria for assessment. 
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TABLE SHOWING CLAUSE AND SENTENCE 
" STRUCTURE “ “ 


S. No Subiect 

Predicator 

Complement 

Adiunc 

1 . 

We 

agreed to let 

the road between 

since 



fall 

us 


2. 

(We) 

bricked up 

our gates :(i) to 

and 




: screen 





:us 


3. 

(We) 

planted 

trees 

— 

4. 

(We) 

turned lose 

all time’s ero¬ 
ding agents/(ii) 
silence, and 
space, and str- 
agers 

and 

5. 

Our neglect 

has not had 

much effect 

“//I 

6. 

Leaves drift 


un swept 

— 

7. 

Grass 

creeps 

unmown 

— 

8 . 

No other change— 


— 

-//n 

9. 

It stands 


so clear 

— 

10.* 

(it) (stands) 


so little 

— 

11. 

Walking that way 

would not 

overgrown 

to nigi 



seen* 



12. 

(Walking that way) 

would be 

strange 

and be 
stHl/I 



allowed 

— 

13. 

(it) is 


a little longer 

if- 

14. 

time 

will be 

stronger 

and/ft 

15. 

ill) drafting a world 
iv) where no such road 





will run from you 
to me 

is 

n y liberty 

-//v 


v) to watch that 





world come up 



X 


vl) rewarding others 



-//VI 

16. 

Not to prevent it 

is 

rry will's fulfilment 

17. 

Willing it 

(is) 

my ailment 

-//VII 
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(a) The linguistic items shown in brackets do not appear 
in the text. 

(b) // marks the sentence boundary and the numeral by 
its side the sentence number. 

(c) Terms used: 


i) Subject: The element of a clause which can 

set up number concord relationships 
with the predicator. 

ii) Predicator: The verbal part of a clause. 

iii) Complement: All nominal elements other than the 

subject. 

iv) Adjunct: Non-nominal elements. 


TEST ITEMS/QUESTIONS 

A The adjunct (Binder) SINCE marks a certain point of 
10 time 


T E 



\ 2 \ Match the verbal group under T B’ with the verbal 


types under'A’ 



A 


B 

1. Action 

LJ 

a) bricked up 

2. Comment 

LJ 

b) drift 

c) stands 

3. Neutral 

LJ 

d) is 

4. Perception 

LJ 

e) planted 

f) would not seem 

5. Others 

'LJ 

g) creeps 


h) has not had 

i) will be 

j) agreed 

k) would be allowed 

t 3» A) which of the following best describes the semantic 
6 relationship of the QUALIFIERS UNSWEPT, 
UNMOWN to SO CLEAR, SO LITTLE OVER¬ 
GROWN? 




a) cessation of activity without much effect 

b) failure of effort and consequent frustration 

c) achievement of the desired end without 

effort _ 

d) neglect of duty without much damage /_/ 


B) Which of the following comes closest to t&e 
description of the subject matter of the poem ? 

(12) a) the ugliness df a road once in use 

b) the damage done to the beauty of a road 

C) the activity to render a road out of use _ 

4) the apathy to keep a road clean. /_/ 


C) Which of the fo&towing comes closest to the des¬ 
cription of the ieme of the poem ? 

(14) dislike of two persons for each other 

^ willing effort of toe participants to create 
strangeness 

Cl sadness of two persons for the break of 
relationship 

d) strong attraction of toe participants for each 

ether 

9) The speaker of the poem is primarily describing 

his 

tt# a) plans 

b) past experiences 

c) feelings 

j’q Whet is the Significance of planting trees to line 3? 

5 Mention the deviant nominal group in the collocation 
13 SILENCE, SPACE AND STRANGERS. 

t Whet is the referent of the pronominal items WE in line 
IS l? 

f The nominal item NEGLECT in line 5 stands in_ 

$ relationship with DISUSE in Une2. 



97 


8 The negative particle in the qualifiers UNSWEPT & 

21 UNMOWN marks the cessation of an activity. Explain 
the kind of awareness shown by the poet in the use of the 
items. Answer in 50 words. 

9 The nominal items TIME, AGENTS, SILENCE, SPACE, 

22 and STRANGERS are divergent on the formal level. 

Slow how the poet has set up a sen.antic inter-relation¬ 
ship between them. Answer in 50 words. 


10 Give an interpretation of the poem in 750-1000 words. 
23 Mention the principles and tools of interpretation used. 
You have only to clarify them and not offer a defence 
for them. 


" The Portrait of a Lady M - Henry James 

1 "He was not romantically, he was much rather obscurely, 
3 handsom”. This obscure appeal of Goodwood’s, however, 

introduces a sexual motif that creates considerable diffi¬ 
culty_. 

’Motif’ in critical parlance means 

A. That which causes somebody to act 

B. Minimal dissection of the thematic material 

C. The goal to be attained through action 

2 "Some critics see this reverie (Ch 42) as the germ of 

3 the "stream of consciousness technique". The basic 
difference between the stream of consciousness technique 
and the technique used here lies in 

A. its lack of depth 

B. its lack of free association of ideas and images 

C. its thematic inadequacy. 
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3 

10 


Given below are some of the remarks of Isabel (Chepter 2) 
iust after her arrival in England. Choose the most appro¬ 
priate conclusion that could be drawn about a certain trait 
of her character. 


"He^ such a perfect little darling. ” 

"I've never seen anything so lovely as this place. I*ve 
been all over, the house; it ! s too enchanting”. 

"Well, he has a lovely place to sit”. 

A. Her high spirits and her desire to please 

B. Her shallow outlook and lack of intelligence 

C. Her hypocrisy and clever feigning. 

4 ”Oh, I hoped there would be a lord; it f s just like a novel. ” 
10 "Please tell me - Isn’t there a ghost? she went on 

"A ghost?” 

"A castle - spectre, a thing that appears. We call them 
ghosts in America. ” 

"So we do here, when we see them. ” 

"You do see them then? You ought to, in the romantic 
old house”. 

With reference to these words, choose the most appro¬ 
priate conclusion about a certain trait of Isabel 1 s charac¬ 
ter. 

A. Her great experience of life 

B. Her sense of humour. 

C. Her viewing of reality through romantic literature. 

5 A significant background explanation of the theme of this 

6 dialogue and the remark earlier is provided by the setting 


A. of the room in which Mrs. Tonchett first met 
Isabel in Albany, 
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B. of the Gardencourt lawn 

C. of the oaken gallery of pictures 

6 Although there are no overt happenings in this Chapter (42) 

36 if nevertheless, as James says, "throws the action further 
forward than twenty incidents might have done. It was designs 
to have all the vivacity of incident and all the economy of 
picture. ” Bring out the beauty and effect of this chapter 
highlighting the technical skill employed by the novelist. 


^ing Lear 1 - Shakespeare 

Good my lord, 

you have begot me, bred me, loved me: I 
Return those duties back as I right fit. 

Obey you, love you, and most honour you. 

1 One of the ways in which Shakespeare contrasts this speech 
3 of Cordelia with the speeches of her sisters is its lingui¬ 
stic usage. This speech is marked by 

A. socially unbecoming words and phrases 

B. syntactic ambiguity 

C. a predominance of verbs. 

2 Mark the repetition of the verb + object pattern, serving 
10 to chop up the rhythm. It reveals the speakers 

A. fluency of speech. 

B. difficulty to heave her heart out 

C. lack of warmth of feeling 

3 One of the functions of the predominance of verbs in this 
14 speech is to make the character seem 
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A. more sincere and down - to - earth 

B. more glib talker 

C. more calculating and hypocritical 

4 The first scene, set in the court of King lear, is said to be 
3 predominantly ritualistic in tone. One of the implications 

is that 

A. The participants know what they are to say and how 

B. The participants are fixed in number 

C. The participants have love and affection for each 
other. 

5 The first scene of ’King Lear’ is said to be predominantly 
21 ritualistic in tone. It in plies that the participants would 

know what is to be said and the way it is to be said. Con¬ 
sider Cordelia’s speech in the light of these remarks, 
accepting the remarks as the criterion. Contrast the 
speech of Cordelia With the speeches of her sisters. Write 
200 words. 



SECTION vm 

SIMPLIFIED METHODS OF TEST AND ITEM ANALYSIS 




SIMPLIFIED METHODS 


In the previous two sections on Test Analysis and Item analysis, 
it was pointed out that the rational and sophisticated methods and cal¬ 
culations for various statistical quantities are both time-consuming 
and call for a fair degree of mathematical ability and comprehension. 
At the same time those who are not familiar with statistics and are 
not that proficient in mathematical calculations must be helped with 
rules of thumb (simple methods) to be able to calculate these statis¬ 
tical quantities though at some loss of accuracy. What is intended is 
that simple methods that yield fairly acceptable and reasonably accu¬ 
rate results are discussed to render a helping hand to teachers who 
are not mathematically inclined to appreciate sophisticated me¬ 
thods. Whenever calculations are inevitable, formats & tables are 
so designed as to render the ’filling in ’very simple for non- mathe¬ 
matics teachers. It is also felt that formats enclosed in this section 
will help the teachers feel confident to undertake test & item analysis 
of all their class tests. These simple methods will be illustrated with 
the same example of 

a) a 20 item objective type test on 76 students and 

b) an actual choice type drawing examination of 8 
questions on 117 students; 

S IMPLIFIED METHODS IN TEST ANALYSIS 

a) MEAN, MEDIAN & MODE: Mean of scores is the usual addition of 
all scores divided by the number of students. For all these 
three quantities there are no short cut methods. Median is the 
middle student’s score while mode is the often repeated score. 

It is possible however for one to get an idea of the value of Mean 
of scores roughly by looking into the highest and lowest marks 
and averaging them out. 

In our two examples (1) 20 item test on 76 students: highest was 
18 and lowest was 6; the average is 18 + 6 = 12 which is nearly 
the Mean of scores = 12.9 13). 2 
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(2) Jh section A and Section B put together for 100 marks pape 
the highest score was 91 and the lowest 43; the average is 67 ar 
the calculated mean was 66.14 ( & 66). 

Section A highest 61; lowest 24;average 42. 5,the calculated 
mean was 41. 0; 

Section B Mean was 24.9 

highest mark = 31 

lowest mark = 14 

Average = 22.5 


b) STANDARD DEVIATION 
a) For objective type tests: 


(Sum of 1/6th highest scores - Sum of l/6th lowest scoresl 
8 Cl “ 1/2 Total number of students 

This formula is suggested by Jenkins of Lehigh University and 
quoted by Paul Dieterich. Here l/6th of the total number of 
students are considered (in our example 1/6 x 76 = 12.67 # 

13 students). 

Sum of Top 13 Student’s scores = 220 
Sum of bottom 13 student’s scores =113 


s.d 


220 - 113 
38 


= 2.81 


We can take scores of 12.67 students also (Top) 
= (18 x 4 + 17 x 4 + 16 x 4.67) 

= 72 + 68 + 74. 72 

= 214.72 


We can take scores of 12.67 student’s also (bottom) = 


= (6 x1 + 7x1 + 8 x 2 + 9 x 6 + 2.67x 10) = 109. 7 
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. 214. 72 - 109. 7 1 05. 02 

sJ= -38- - - 38 — 

* 2.77 

Actual s.d calculated on the basis of the RMS value of devia¬ 
tions of individual scores over the mean = 2. 79 

b) For choice type examinations: 

There are two alternatives 

One is to use Jenkins formula 


^_ (Sum of l/ 6 th Highest - Sum of l/ 6 tfa lowest) 
1/2 x Total number of students ” 


the other is to use Harper’s formula 

(Sum of l/5th highest- Sum of l/5tn lowest) 
1/2 x Total number of students 

1/6 x 117 = 19. 5 & 20 students 
1/5 x 117 = 23.4 #23 students 


For Section A and Section B put together 

. , r t . v (1563 - 1062) — ft 55 

s.d (Jenkins) = -gg-jj- -o.oo 


(1781 - 1239) 
58.5 


= 9.25 


s.d (Harpers) 

The actual value calculated = 8 .34 
Jenkins formula is a better one. 

(1018 - 564.5) 453.5 

Section A above; s.d (Jenkins) -- 5 g 5 


= 8.00 

= ~ —> = 491 = 8.37 

58.5 * 


s.d. (Harpers) 
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Actual value = 7.16 
Here again Jenkins is a better one. 


c) STANDARD ERROR OF THE MEAN = s.d 

v/N -T 

use the approximate value of s. d. 


d) INDEX OF MEASUREMENT EFFICIENCY 
1ME = 1 - ■ »* (McMorris) 

Where k = number of items 

2 2 
flr* o - variance of test scores = (sd) 


This can be used only for objective type tests. The smaller the 
number (k), the lower the estimate of the Index and any value 
above 0. 75 is likely to indicate a very good reliability for the 
test. For large values of k, this formula will yield comparable 
results with other methods. 


Example 20 item test on 76 students 


IME 


0.16 x 20 
2 

*o 


3.20 

7.79 


4.59 

7.79 


0. 59 


This is almost the same as reliability by many methods. For 
greater values of k there will be remarkable identity of values 
between this McMorris formula and other reliability estimates 
The following table also can be used to find reliability of ob¬ 
ject ive type tests. 
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TABLE 1 

Approximate reliability of easy test (average 70% to 90% correct) 

Number of items (n) 20 30 40 50 60 70 80 90 100 

if SD is 0.10n 0.21 0.48 0.62 0.69 0.75 0.78 0.81 0.83 0.85 

if SD is 0.15n 0.68 0.80 0.84 0.88 0.90 0.91 0.92 0.93 0.94 

if SD is 0.20n 0.84 0.90 0.92 0.94 0.95 0.96 0.96 0.97 0.97 

TABLE 2 

Approximate reliability of hard tests ( average 50 to 70% correct) 

Number of items(n) 20 30 40 50 60 70 80 90 100 

if SD is 0. lOn - 0.21 0.41 0.53 0.61 0.66 0.71 0.74 0.77 

if SD is 0.15n 0.49 0.67 0.75 0,80 0.84 0.86 0.88 0.89 0.90 

if SD is 0.20n 0.74 0.83 0.87 0.90 0.92 0.93 0.94 0.94 0.95 

To use the table in the case of our 20 item test, x = 12 .9 = 64. 5% 

sd = 2.79 = 0.14n 

Table 2 can be used r = 0 .49 

better value can be 0.49 + -j- (0.68 - 0.49) = 0. 54 

Table I has an average difficulty of 80% while Table 2 
average of 60%. 65% is just l/4th away from 60% 

e) RELIABILITY 

a) for objective type tests 

1) Sjolit half relaibility : - between two measures x & y if 
correlation is required (Product Moment), we have seen that 
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If the class size is small (upto 40) odd-even score correlation 
that gives split halves reliability can be calculated by this. 

A Simple formula is to use r = ~ ^ ~ ^ — 

Where x = Mean Sx = s.d of x 
y = Mean S y - s. d of y 
N - Number of students 
A table tsan be set to fill in these quantities 

S.NO. X Y (x-1) <y-y) <x-X) 4y-y) 


Yet another simple method for finding correlation between 
two measures (odd,even scores etc), tetracfcorlc B r f can be 
read from the following table. 


% 

r 

% 

r 

% 

r 

% 

r 

% 

r 

45 

0 .95 

37 

0.69 

30 

0.31 

21 

-.25 

13 

-.69 

44 

0.93 

36 

0.65 

29 

0.25 

20 

-.31 

12 

-.73 

43 

0.91 

35 

0.60 

28 

0.19 

19 

-. 37 

11 

-.77 

42 

0.88 

34 

0.55 

27 

0.13 

18 

-.43 

10 

-.81 

41 

0.85 

33 

0.49 

26 

0. 07 

17 

-.49 

9 

-.85 

40 

0.81 

32 

0.43 

2 $ 

0 . 00 

16 

-. 0.55 

8 

-.88 

39 

0.77 

31 

0.37 

24 

-0. 07 

15 

-.60 

7 

-.91 

38 

0.73 

- 

- 

23 

-0.13 

14 

-.65 

6 

-.0.93 


22-0.19 






109 


To use the table 

Find the percentage of students who stood in the top half of the 
group on both measures you are correlating and look up the correla¬ 
tion (r) corresponding to this percentage in the above table. 

These are called tetrachoric correlations while the more • 
common but more difficult kind are called "product-moment cor¬ 
relations". They mean the same thing, in the sense that the tetra¬ 
choric yield a fairly accurate estimate of the correlation that you 
would get by the product moment method. Tetrachoric r s are 
perfectly respectable and are often used in educational research but 
they are not very precise since a difference of 1% can make a 
difference as great as 0. 07 in the correlation. However the relia¬ 
bility of the data that teachers usually have to work with and the 
relatively small number of students involved do not justify more 
precise methods of computation. A rough idea of relationship is 
enough. 

Since even 1% of the students can make so much difference 
in the correlation, it is Important to use a standard, uniform me¬ 
thod of counting how many students stood in the top half on each 
measure. To find the middle score on each measure: 

1 . List the scores on each measure from highest to lowest 
and put a tally after each score for each student who made 
it. 

2 . After all the scores have been tallied, count down the 
tallies to half the number of students in the group. 

3. The score at which this middle tally falls is the middle 
score. 

You will ordinarily have the students listed in alphabetical order 
and after each name, you will have the two scores that you are 
correlating. After you have found the middle score on each mea¬ 
sure, go down the list and put a check (V ) after each score that 
stands above the middle score on that measure; a straight line 
after each score that stands at_ the middle score. Do this separa¬ 
tely for each of the two measures. 

Then if you need six students with middle scores on Measure 
A to take in half of the group, put a check ( ^) through the first 
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six straight lines on Measure A that you come to in alphabetical 
order. If you need four more Students with middle score on Mea¬ 
sure B, put a check ( */) through the first four straight lines after 
the scores on that measure. The count how many students have 
two checks ( V) after their names; turn this number of students 
into % age (not by the number in the top half) look up this percentag* 
in the above table. The decimal corresponding to it will be the 
correlation between the two measures. 

It is not nhcessary for the two measures to be on anything 
like the same scale. It is perfectly valid for example to correlate 
the height in inches with weight in pounds; or scores on an objec¬ 
tive test that run from 200 to 800 with scores on an essay that run 
from 1 to 9. All that is necessary is to count how many students 
stood in the top half of this same group on both measures. 

It is impossible and meaningless, however, to correlate the 
scores of two different groups on the same measure, for example, 
to correlate scores of boys with those of the girls, teachers often 
speak loosely of Correlating* one class with another when they 
really mean comparing. There is no way to correlate two groups 
of students on the same measure; one can only correlate two sets 
of measures on the same students. To compare the performance 
of two groups of students on the same test or measure, you com¬ 
pare their averages and if you want to find out whether the average 
’really* different you compute the standard errors of these averages 
and then the standard error of the difference. 

The topic of correlation is related to the topic of reliability 
because often the only way of computing the reliability of a test is 
to give two tests of the same ability and correlate the two sets of 
scores. This is true of essay tests and tests in which the items 
receive different number of points. The KR formula is applicable 
to objective type tests. 


Rulon formula (odd-even) rtt = 1 - 

d = 


2 


*d 

2 

«t 


Where 


difference between two half 
scores of an examinee. 



Ill 


<*3 = S. D. of those differences 
= S. D. of total scores 


S.D. of differences is only to be found 


K. R. formula 20 : 


n - 1 


1 

i = 1 


piqi 


can be easily applied 

b) for essay type/ c h oice type examinations:- 

Coefficient alpha for all compulsory questions type 
n 2 

^ *7 


r oT 


n 

n - 1 


1 - 


i=l 


2 

d"o 


Individual question variances can be found out. 

Approximate s.d. calculation formula can be used. 
Ch oice type 


Nuttall (1969) N4 formula can be easily applied 


t k 2 k "1 

1-1 (f n jSj )/»x f "j J 

1 = number of questions to be attempted 

k = number of questions set 

nj = number of students who answered question j 

Sj 2 = variance of scores on question j 

s = variance of total scores 
X (The use of this has already been illustrated) 
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STANDARD ERROR OF MEASUREMENT 
SEM = sd/T ~r 

Where sd = value calculated by approximate methods 

r = least reliability coefficient. 

This will give the class teacher an idea of the 
S. Error of Measurement. 

for ob j ective type tests 

SEM = yo. 16 K 

Where k = number of items 

It is an approximation derived from McMorris formula. 

IME = (1 - —) Since 0.16 k accounts for 'error 
variance* 

for choice type/essay type 
SEM = sd/l - r 


DERIVED SCORES 


The derived scores that can be worked out by the classroom 
teacher are 2 scores, T scores, CEEB and Percentile Rank. 

Z Score for every individual = ^^a^evL T i ' on = <Z 8ay) 

(x = Mean) 

T score for the individual = 10Z + 50 (T say) 

CEEB score for the individual = 10 T 
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P. R. calculation has already been illustrated. 

A Tabular statement will help teachers fill up the values and 
arrive at all these derived scores simply. 

SIMPLIFIED METHODS OF ITEM ANALYSIS 


Item analysis or question analysis (as applied to supply type) 
consists in analysis for two important characteristics; facility 
value and discrimination index of every item/quest ion. While there 
are sophisticated and very rational techniques available (already 
discussed and illustrated), certain simplified methods are given 
here to help teachers (who are not quite competent in statistics) 
to calculate these characteristics. 

a. FACILITY VALUE 

1 . for objective type tests 

F V = Number answering the item right _ y ^ 

- ‘Total number attempting the item 

of an item 

1) Total population can be taken into account when 
the class strength is small ( <40). 

2) When it is between 40 and 100, top-bottom 27% 
alone needs to be considered 

3) When class strength is beyond 100, top-bottom 
10 % will be sufficient. 

A number of formats to help teachers to mechanically do this 
F. V. analysis is given at the end ef this section. They are all self- 
explanatory. 

2 . for choice type questions 

There are two alternatives 

l) F. V. of a question = (50 + Mq - M T ) (Morrison) 

Where Mq = Mean percentage mark on that 
question for all candidates 
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Mrp = Mean ability in percentage total mark 
of those who attempted the question. 

a) if class strength is upto 40, entire population can 
be taken into account. 

b) if strength is between 40 and 100, top-bottom 27% 
alone needs to be considered. 

c) if strength is > 100, 10% top-bottom will be 
sufficient. 


ii) FV of a question = M + Mq - Where M = 
Mean % marks (Willmott, Nuttall) 

Dr. Edwin Harper, however has suggested the following formula 
for F.V. 

Mu + M L 

^2 x Max. Marks for the question X 


My = mean mark of top l/5th of students on the question 

M l = mean mark of bottom l/5th of students on the ques¬ 
tion. 


Turning to our illustrative example of 8 questions, choice type 
examination on 117 students, values of F. V. are calculated by 
Harper formula & compared with the more rigorous values ob¬ 
tained by Morrison Index. 

Table below shows the calculations:- 1/5 x 117 = 23.4 

£2 23 students 


S. NO 

QN I QN II 

QN III 

QN VI 

QN V 

QN VI 

qn vn e*»«* 

1 M u 

3 M i * 1307 7 46 

8.15 

5.87 

0 

6.80 

O.tf 7.20 

2. M l 

~~~ =9 ? 6 2.15 

23 

5.22 

3. 78 

0.13 

4.00 

l.M ft. 4 

F. V.= 

Mu+ '* L 07 + 9.76 ’ 

46+2.15x100 






2xMax. 2 x 15 xl0 ° 

Marl “ . 78.1% =48. 05% 

2 xlO 

66. 85% 

48.25% 

5% 

52% 

11% 63% 


MorriMB 

Index 

62 . 5 % 54 . 1 % 56 . 5 % 26 . 5 % 12 % 44 % 22 % 48 % 
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It may be that method suggested by Dr. Harper is suitable for no choice 
essay type examination. 

b. DISCRIM INAT ION INDEX 

1 . for objective type test items 

D. I. of an item = (F. V) higher ability 27% - (F. V) lower ability 27% 
(Johnson upper lower index) 

This is quite in order for classroom tests. 

a. if strength is<40, 50-50 grouping can be done (or 27%-27% also) 

b. if strength is between 40-100, 27%-27% will be alright 

c. if strength is >100, 10%- 10% grouping will be in order. 


Formats to enable teachers to come up with DIs of all items in a 
mechanical & systematic way are given at the end of this section. Making 
use of 27% -27% and the graphs for Biserial, Point Biserial, Tetrachoric 
and Phi coefficients, one can easily find out D. I. 

2 . for choice type questions: 

There are two alternatives: 


a. DI is the product moment correlation between marks on the 
question & total marks 

This can be done In the usual way (or) it shall be easily cal¬ 
culated from the formula 


DI = 


«(x-R) (y-y) 
NSxSy 


Where x mark on question (whose DI is to be found) of 
a given student 


y total marks of the same student 


N 


number of students 
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sd of x 
Sy sd of y. 

b. DI is the product moment correlation between marks on the 
question with (Total marks - that question mark) 

No simple method is however possible if we retain the basic definitio 
of D. I. Dr. Edwin Harper has suggested a simple formula for DI. 

D L = _l-8 (Mu - M,) _ 

Max. Marks for the question 


A comparison is made for these 8 questions with respect to the value 
obtained earlier by rational method & this simplified method. Table 
below shows the comparison. 


S. NO 

QN I 

QN II 

QN III QNIV QN V 

QN VI QN 

QN 





VH 

VIII 

D. I. = 

1.8(M U - Ml) 

Max. x mark 

0.40 

0.956 

0.527 0.38 -0.023 

0.50 0.07 

0.32 

D. I. 

0.48 

0.75 

0.52 0. 50 0.24 

0.50 0.49 

0.46 


5. DERIVED SCORES z _ Raw score - x _ / 2 say ) 

FOR EVERY STUDENT S. D 

T = 50+1Oz 
CEEB= 10 T 


Percentile Rank 
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OBJECTIVE TYPE TEST ANALYSIS 


TEST NUMBER_ TIME_ 

NUMBER OF ITEMS_DATE_ 

N (Number of answer sheets) = -_1/6 N =_ 

UPPER GROUP/LOWER GROUP 27% of N =_ 

K = number of test items =_0.16 K = 


c = average number of choices/item =__ 

, « - SUM OF ALL SCORES 

1 . Mean x = -^- =_= 

Median = Middle Student’s Score = 

Mode = Frequent score = 

2. STANDARD DEVIATION = ISum of 1/6 top) - (Sum of l/ 6 bottom ) 

N/2 

(When N is small use (N-l) instead of N = 
in the denominator) 

3. RELLABIUTY/INDEX OF 0.16k ( ) 

MEASUREMENT EFFICIENCY r ' S.D2' S. D^ 

4. STANDARD ERROR OF MEASUREMENT 

SEM=v/0.16k = 


= SU /1 - r 



Percentile Rank Calculation 
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6 . S TANDARDS (suggested by Edwin Harper) 

1 . Minimum acceptable Raw score = 

c number of options 


against obtained value of_ 

against obtain¬ 
ed value 


Ideal Mean = —■ + -ji = 


3 Ideal s.d. = ~ =-against-actual 

value 

SD 

4. Ideal SEM = less than actual— --against the 

value-•- 

5. Ideal IME = 0. 75 and above against-- 

6 . ^peededness 90% against actual value- 

A SUITABLE GRADING SYSTEM 
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STATISTICAL ANALYSIS SHEET 


COURSE_SUBJECT_ TOTAL SCRIPTS. 

DATE _ NUMBER IN HIGH GROUP_ 

NUMBER IN LOW GROUP_ 
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Total number of marks (n) possible =- 

Mean score = £c = (12.80) marks 
Standard deviation 

*d -U*<L _. rk = 2 96 
ar = - 2.45 mar 8 /ab 

Reliability 

n r, * e 1 _ .20 r 3.9 5 T 

r ' n " 1 L 1 " a-2 J 19 L 1 " 8.80 J 

__20 |~4.85 I _ 

19 [ 8^80 J 0 58 

Standard error 

e n = / 1 - r '^tr- =2.96/l-0.58 = 2.96/02 


= 1.91 marks 


marks 
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ANALYSIS OF CHOICE TYPE EXAMINATION 

YES NO 

NUMBER OF QUESTIONS _ FREE CHOICE ~ /~ 

NUMBER OF QUESTIONS INTERNAL CHOICE /~/ LJ 

TO BE ANSWERED _ 

1 COMPULSORY QN /— 

& FREE CHOICE — — 7 

NUMBER OF COMBINATIONS_ TIME_ 

NUMBER OF STUDENTS _ DATE _ 

MAX. MARKS_ 

PERFORMANCE MATRIX 


S. NO; 

I ROLL 
NUMBER 

QN I 

Qn n 

QN III 


QN X 

TOTAL 










ANALYSIS 

1 MEAN 


Sum total marks of all students 
Number of students 


2 


MEDIAN = MIDDLE STUDENTS SCORE =- 

MODE = OFTEN REPEATED SCORE/S = - 

STANDARD DEVIATION : ACCURATE VALUE ^% /ft-SQ 2 

N 


APPROXIMATE VALUE 


(Sum l/6th hig hes t - Sum 1 /6th lowest) 
1/2 x Total number of students 


3 STANDARD ERROR OF THE MEAN = 

r/N - 1 


4 RELIABILITY 

a. NUTTALL N 4 FORMULA. 

b. 

5 STANDARD ERROR OF MEASUREMENT = SEM = s. d# 1 - r 


6 DERIVED SCORES 


2, T, CEEB, P. R. 
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ITEM/QUESTION ANALYSIS 


NUMBER OF QUESTIONS 

_ CHOICE TYPE 

YES 

LJ 

NO 

LJ 

NUMBER OF QUESTIONS 

TO BE ANSWERED 

_ FREE CHOICE 

LJ 

LJ 

NUMBER OF COMBINA¬ 
TIONS 

INTERNAL 
_ CHOICE 

LJ 

LJ 

NUMBER OF STUDENTS 

1 COMPULSORY 
QN & FREE 
CHOICE 

LJ 

£17 


(A) FACILITY VALUE 


)Q NO. 


MQ 

(Mean % Mark 
on question) 

MT 


QN I 


(Mean % total 
mark of those 
who attempted 
question) 


Morrison 


F. V. = 


50 + B^-M t 


Wlllmott- 

Nuttall 

M+Mq~M t 


(B) DISCRIMINATION INDEX 
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x = 

y 

£ (X-X) <y-y) = 

N = ___ 

g _ J 2 

- V-tf— " x 




^ (X- x) (y-y) 







ITEM ANALYSIS NUMBER OF STUDENTS = 23 

OBJECTIVE TYPE NUMBER OF ITEMS = 15 

































DISTRACTOR ANALYSIS FORM FOR MULTI CHOICE/MATCHING ITEMS 
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Delete as applicable 




SECTION IX 

FUTUHE OF QUESTION BANKS 




FUTURE OF QUESTION BANKS 


Question Banking remains in the category of 
promising ideas. A few developments could change this 
situation. Universities/examining boards could join 
together, pool resources so that teachers could begin 
to request, more vociferously than in the past, access 
to bank of questions/items for the purpose of classroom 
testing and continuous assessment. Some universities 
have already built up question banks which they could 
put at the disposal of teachers. The AIU has developed 
nearly 60,000 questions/items in 10 subjects (Mathematics, 
Chemistry, Physics, Botany, Zoology, History, Psychology, 
Geography, Economics and Commerce) at the first degree 
level and can make them available either in the form of 
cards in Kardox trays as a system or in die form of 
booklets in A4 size double column single space arrange¬ 
ment. At the same time nothing must stop local groups 
of teachers banding together immediately to form their 
own question banks using their own and other materials. 

It is also proposed to take up other popular subjects 
at the First degree level in future. It is firmly 
believed that item/question banking is the examining 
systemof future. It is also felt that a few large 
universities can try this out and make their experiences 
available to ail others. 

The question of the cost of item question banking 
in comparison^ with other systems of examining and 
achieving comparability isan important one. At an 
Initial level, the rationalizing effect of question 
banking would seem bound to make it the cheapest 
examining method of all. Yet we are unable to 
demonstrate these advantages simply because no 
comparison of die cost effectiveness of the various 
examining and comparability procedures has been worked 
out. Some idea of the relative costs can be obtained by 
totalling what it currently costs to examine candidates in 
say these ten subjects every year. To this can be added 
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the amount which the Boards and/or universities pay -either to 
have an effective cross moderating network or to continue 
with annual monitoring exercises. It will be surprising if ques¬ 
tion banks in these subjects cannot be operated for considerably 
less than this amount. 

Plans of action for setting up question banks in 
individual universities have been given elsewhere. Some 
universities have launched upon this; others are on their 
way to. The function of the AIU is to coordinate these 
efforts and also institute initial fairly large questions/items 
banks in more popular first degree level subjects and make 
them available to all universities in the country. However, 
the future of question banks in this country at the level of 
higher education depends to a very large extent on the 
awareness and understanding of a system of question bank 
on the part of administrators. Boards of Studies members, 
examiners and teachers. There is no doubt that this will be 
successful over a period of time since there is sample 
evidence to showthat individual universities/colleges/other 
organisations are keen and enthusiastic to develop 
question bank in many subjects. Thus question bank will 
make a potential contribution and add a new dimension to 
the process of examining in higher education. 
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CHECKLIST OF CRITERIA FOR PREVALIDATION OF 
QUESTIONS/ITEMS FOR QUESTION BANKS 


CRITERIA TO JUDGE THE QUALITY OF SELECTION TYPE 
ITEMS 

A. GENERAL 

1.0 Is the item measuring an important learning 
outcome? 

2. 0 Is the item measuring an important content area? 

3. 0 Is the level of difficulty likely to be right? 

4.0 Is the item likely to be answered correctly by 

higher ability students? 

5. 0 Is the item likely to be answered wrongly by lower 

ability students? 

6. 0 Is the item independent or does it overlap with other 

item s ? 

B. SPECIFIC 

(i) Constant Alternative Type 

1. 0 Does the item include only one significant idea 

in each statement? 

2.0 Is the statement so precise that it can be judged 
unequivocally true or false? 

3. 0 Is the statement short and in simple language? 

4. 0 Does the item use negative statements sparingly 

and avoid double negatives? 

(ii) Multiple choice/Multiple facet types 

1.0 Is the stem concise and unambiguous? Is the 
negative (if unavoidable) emphasized? 

2. 0 Is the stem a complete question by itself? Does 

the item require the student to read the options to 
discover what is being asked? 

3. 0 Is the content of the question clear? 

4. 0 Doo° the stem include anything that needs 

to be repeated in every option, within itself? 

5. 0 Are the options parallel in content? 
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6. 0 Are the options parallel in structure? 

7. 0 Is the item devoid of any clues such as mix up of 

singular, plural, precision and length of key option 
etc. 

8. 0 Is the key option unarguably correct? 

9. 0 Are the distractors plausible? 

10. 0 Does the item exclude M all of these”? 

11. 0 Is the language used in the item appropriate to 

the vocabulary of students at this level? 

12. 0 Does the item avoid similarity of wording in both 

stem and the correct answer ? 

13. 0 Does the item exclude responses that are ”all 

inclusive"? 

14. 0 Does the item use an efficient format? 

(iii) Matching 

1. 0 Does the item include only homogenous material in 
the "premises”? 

2.0 Is the number of responses sufficiently large so 
that the last of their premises can still have many 
options to choose from ? 

3. 0 Does the item specify the basis of matching, type 
of matching, kind of entry etc. ? 


CRITERIA TO JUDGE THE QUALITY OF SUPPLY TYPE 
TEST ITEMS 

A. GENERAL 

1.0 Is the item measuring an important learning 
outcome? 

2. 0 Is the item measuring an important conte t area? 

3. 0 Is the level of difficulty likely to be right? 

4.0 Is the iten. likely to be answered correctly by 

higher ability students? 

5.0 Is the item likely to be answered wrongly by lower 
ability students? 

6.0 Is the item independent or does it overlap with 
other items? 
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B. SPECIFIC 

(i) Simple question/completion 

1.0 Is the item so stated that a single, brief answer is 
possible? (a word, a number or a phrase) 

2. 0 Is the question direct? 

3. 0 Is the answer related to the main point in the 

statement? 

4. 0 Does the item with the blank spaces makes enough 

sense so that a student knows what to do? 

5. 0 Does the item in the case of a numerical answer 

indicate the degree of precision? 

<ii) Short answer Questions 

1.0 Is the statement of question simple, clear, 
unambiguous ? 

2. 0 Does the question involve observable, measurea^ 

behaviour? 

3. 0 Is the scope of the answer limited? 

4. 0 Is the direction given in the question, clear? 

5. 0 Is the question a valid testing situation for the 

ability considered? 

6.0 Is the question likely to be interpreted in the sar ' 
way by teachers/students/examiners? 

7. 0 Is the answer to the question capable of being 
marked objectively? 

8.0 Is the question likely to have the right kind of 
difficulty value? 

9. 0 Is the question likely to be answered correct!}' 
by many higher ability students? 

10. 0 Is the question likely to be answered wrongly 
by many lower ability students? 

11.0 Is the question capable of further restructuring? 

(iii) Long answer 

1. 0 In answering this question, in your opinion does the 
student need to organise his ideas, choose the form 
of his answer in his own words? 



144 


2. 0 Does the situation presented in the question seem 
to be new to most of them ? 

3.0 Is it possible that students can produce memorised 
answer to this question? 

4. 0 Does answering this question involve sort of 

judgement on the part of students ? 

5. 0 Is the tin e limit reasonable? 

6. 0 Is the length and scope of the answer specified? 

7. 0 Does it avoid usage of very open verbs? 



